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(54) Image pickup apparatus having a front and rear camera 



(57) An image pickup apparatus includes a front and 
a rear camera for generating video signals from scenes 
in a first direction and a second direction and a signal 
processing device that changes one of a frame rate and 
a compression rate of the video signals in the first and 
second direction. The apparatus further includes a de- 
tection device for detecting that a state of the apparatus 
matches a predetermined condition for changing the 
frame rate and/or compression rate of the video signal 
and a controller for controlling the signal processing de- 
vice so as to change the frame rate and/or compression 
rate of the video signals in the first and/or the second 
direction on the basis of the detected condition. 
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Description 

Background of the Invention 

[0001] The present invention relates to an image pick- 5 
up apparatus and method, a signal processing appara- 
tus and method, and a wearable signal processing ap- 
paratus. An embodiment of the present invention relates 
to an image pickup apparatus and method for picking 
up video and sound in many directions. The image pick- 10 
up apparatus can be used "hands-free" so that a user 
may pay attention to matters other than picking up im- 
ages. 

[0002] An image pickup apparatus such as a portable 
video camera or the like has many commercial and res- 15 
idential uses. For example, in ordinary households, it 
can be utilized for capturing and recording events such 
as an athletic competition or stages in a child's growth. 
In commercial areas, the. video camera can be used for 
monitoring/security purposes. However, in such in- 20 
stances, a surveillance camera that is fixed to a perma- 
nent position is utilized. In many instances, a user can 
not concentrate on performing image pickup to record 
an event relate to work when the user is working. For 
example, although a security guard may be able to carry 25 
a portable video camera, its use may interfere with the 
security guard's duty. That is, the security guard or po- 
lice officer can not effectively pay attention to his sur- 
roundings while concentrating on performing the image 
pickup operation. Accordingly, security guards and po- 30 
lice officers do not carry video cameras while on patrol. 
However, the use of a video camera during patrol may 
be effective. 

[0003] Further, a desired scene or a scene which de- 
serves recording may not lie in a direction for image 35 
pickup. Such situation may occur when a user is unable 
to pay much attention to the image as, for example, dur- 
ing patrol type work, wherein image pickup may not be 
easily performed. 

[0004] Accordingly, an image pickup apparatus that 40 
does not require the user's concentration as to its oper- 
ation would be desirable. An embodiment of the present 
invention seeks to enable high quality images to be ob- 
tained in appropriate directions, even if the user does 
not concentrate on the image pickup operation. 45 

Summary of the Invention 

[0005] One aspect of the present invention provides 
an image pickup apparatus comprising a video signal 50 
generating device for generating video signals in a first 
direction and a second direction, a signal processing de- 
vice for changing a frame rate of the video signals in the 
first and the second direction, a detection device for de- 
tecting that a state of the apparatus matches a prede- 55 
termined condition forchangingtheframe rate of the vid- 
eo signals, and a controlling device for controlling the 
signal processing device so as to change the frame rate 



of the video signals in the first and/or the second direc- 
tion on the basis of the predetermined condition corre- 
sponding to the state of the apparatus detected by the 
detection device. 

[0006] Another aspect of the present invention pro- 
vides a signal processing apparatus and method for 
processing a video signal comprising, a generating de- 
vice, having bi-directional image pickup devices, for 
shooting scenes in a first direction and a second direc- 
tion and for generating a first video signal and a second 
video signal respectively corresponding to the scenes 
of the first and second directions, a compression device, 
connected to the generating device, for receiving the 
first and second video signals and for performing a com- 
pression process on the first and second source video 
signals with variable compression rates to generate a 
first compressed video signal and a second compressed 
video signal, a transmitting device for transmitting the 
first and second compressed video signals with variable 
transmission rates, a detecting device for detecting an 
event in a shooting position to generate a detection sig- 
nal indicating at least a direction in which the event oc- 
curred, and a controlling device for controlling the vari- 
able compression rates and the variable transmission 
rates in response to said detection signal such that the 
video signal corresponding to the detection has priority. 
[0007] A further aspect of the present invention pro- 
vides a wearable signal processing apparatus compris- 
ing, an image pickup device for generating a source vid- 
eo signal, a signal processing device, connected to said 
image pickup device, for receiving said source video sig- 
nal and for performing image compression on the 
source video signal to generate compressed video sig- 
nal with variable compression rates, a recording device 
for recording said compressed video signal on the re- 
cording media with variable frame rates, and a mounting 
device for mounting the image pickup device, signal 
processing device and recording device on the cloth of 
the operator, whereby the devices are worn by the 
mounting device. 

Brief Description of the Drawings 

[0008] For a better understanding of the present in- 
vention, reference will now be made by way of example 
to the accompanying drawings in which: 

Fig. 1 is an explanatory view of outer appearance 
of a video camera according to an embodiment of 
the present invention; 

Fig. 2 is an explanatory view of the use of the video 
camera of Fig. 1 ; 

Fig. 3 is an explanatory view of a viewing angle of 
image pickup of the video camera of Fig. 1 ; 
Fig. 4 is an explanatory view of a system configu- 
ration using the video camera of Fig. 1 ; 
Fig. 5 is a block diagram of the video camera of Fig . 
1; 
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Fig. 6 is an explanatory view of an operation mode 

and rate change of the video camera of Fig. 1 ; 

Figs. 7(A) to 7(C) are explanatory views of the frame 

rate change in the video camera of Fig. 1 ; 

Figs. 8(A) to 8(C) are explanatory views of the frame 

rate change in the video camera of Fig. 1 ; 

Figs. 9(A) to 9(C) are explanatory views of the frame 

rate change in the video camera of Fig. 1 ; 

Fig. 1 0 is an explanatory view of various examples 

of rate change; 

Fig. 1 1 is a flowchart of rate change processing that 
may be preformed by the video camera of Fig. 1 ; 
Fig. 12 is a flowchart of rate change processing 
based on a sound check that may be preformed by 
the video camera of Fig. 1 ; 

Fig. 13 is a flowchart of rate change processing 
based on an image analysis that may be preformed 
by the video camera of Fig. 1 ; and 
Fig. 14 is a flowchart of rate change processing 
based on detection of current position and detection 
of direction that may be preformed by the video 
camera of Fig. 1 . 

Detailed Description of Illustrative Embodiments of the 
Present Invention 

[0009] Hereinbelow, an illustrative video camera ac- 
cording to the present invention will be described in the 
following order. 

1 . Aspect of Video Camera and System Configura- 
tion 

2. Construction of Video Camera 

3. Image Pickup Operation Mode 

4. Rate Change by Operation or Instruction 

5. Rate Change by Sound Check 

6. Rate Change by Image Analysis 

7. Rate Change by Position Detection 

8. Modification 

1 . Aspect of Video Camera and System Configuration 

[0010] Fig. 1 shows an external appearance of a video 
camera according to an embodiment of the present in- 
vnetion. The video camera has a camera unit 1 and a 
control unit 10. The camera unit 1 and the control unit 
10 are interconnected via a cable 31 such that signal 
transmission can be performed therebetween. As 
shown in Fig. 2, the camera unit 1 can be attached to a 
user's shoulder. On the other hand, the control unit 10 
can be attached or held around the user's hip or in a 
pocket of his/her clothing, such that the user can per- 
form "hands free" image pickup while carrying the cam- 
era. 

[001 1 ] Various ways to attach the camera unit 1 to the 
shoulder can be utilized. For example, a mechanism to 
hold a base unit 6 of the camera unit 1 may be formed 
on the user's clothing bracket or the like for security 



guard duty), or the camera unit may be attached to the 
shoulder by using a harness belt or the like. In addition, 
the camera unit 1 may be fixed to an upper part or a side 
portion of a helmet which the user wears, or may be at- 
5 tached to the user's breast or arm. The shoulder is a 
part in which swinging is normally at a minimum even 
when the user is walking, therefore, it is an optimum part 
to attach the camera unit 1 to for performing image pick- 
up. 

10 [0012] As shown in Fig. 1 , the camera unit 1 has two 
camera parts, a front camera 2a and a rear camera 2b. 
Further, a front microphone 3a and a rear microphone 
3b corresponding to the front and rear cameras 2a and 
2b may also be provided. The front camera 2a performs 
15 image pickup to obtain an image of a scene in front of 
the user and the rear camera 2b performs image pickup 
to obtain an image of a scene in the rear of the user with 
regard to the arrangement shown in Fig. 2. 
[0013] The front camera 2a and the rear camera 2b 
20 may have a wide-angle lens having a comparatively 
wide image-pickup viewing angle as shown in Fig. 3. By 
using both front camera 2a and rear camera 2b, image 
pickup can be performed to cover almost the entire pe- 
rimeter or surroundings of the user. Although the front 
25 viewing angle and the rear viewing angle as the respec- 
tive image pickup ranges of the front camera 2a and the 
rear camera 2b are relatively wide, they can be set to 
various levels in accordance with the design of the lens 
system to be employed or the like. The viewing angle(s) 
30 may be set in correspondence with a situation where the 
video camera is to be used. It may not be necessary to 
set the front viewing angle and the rear viewing angle 
to the same angle. 

[0014] The front microphone 3a has a high directivity 
35 in the frontward direction from the user with regard to 
the arrangement shown in Fig. 2 and may pick up sound 
corresponding to a scene obtained by the front camera 
2a. The rear microphone 3b has a high directivity in the 
rearward direction from the user with regard to the ar- 
40 rangement shown in Fig. 2 and may pick up sound cor- 
responding to a scene obtained by the rear camera 2b. 
The directivities of the front microphone 3a and the rear 
microphone 3b may be set in a similar or different man- 
ner. As such, various designs may be utilized depending 
45 on purpose. For example, a camera unit with one non- 
directional microphone may be employed. 
[0015] A light emission unit 4 is formed in an upper 
part of the camera unit 1 . The light emission unit 4 emits 
light by a light emitting diode (LED) or the like upon im- 
50 age pickup by the front and rear cameras 2a and 2b. 
The light emitted by the light emission un it 4 may be con- 
tinuous or flashing. Such light emission demonstrates 
image pickup operation of the video camera to people 
around the user. Thus, the operation of the video cam- 
55 era may not operated in stealth or secret operation. Fur- 
ther, in a case where a security guard or police officer 
uses the video camera, as the light emission unit 4 in- 
dicates execution of an image pickup operation, the ef- 
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feet of crime prevention is improved. 
[001 6] The control unit 1 0 has a recording function for 
recording a video signal (and/or a sound signal) ob- 
tained by image pickup by the camera unit 1 on to a 
memory card 30, a function for transmitting the signal 
from an antenna 12 to a management station to be de- 
scribed later, a user interface function for display and 
operation, and the like. For example, a display unit 11 
such as a liquid crystal display (LCD) panel may be pro- 
vided on a front surface of the control unit 1 0. The an- 
tenna 1 2 for communication may be formed in a desired 
position. A card slot 13, in which the memory card 30 
may be inserted, may be formed in a desired position. 
Electronic data or sound may be output from a speaker 
14 and/or a headphone terminal 19. Further, a cable 
connection terminal 1 5 is provided for data transmission 
with an information device by a predetermined transmis- 
sion standard such as universal serial bus (USB) or 
IEEE 1394. 

[001 7] The user is provided with various operation el- 
ements such as a power switch 16, operation keys 18, 
and an emergency switch 1 7 to operate the image pick- 
up apparatus. The operation keys 18 may include, but 
are not limited to, a cursor key, an enter key, and a can- 
cel key. The operation keys 1 8 may also include keys to 
input commands using a cursor on the display unit 1 1 or 
specialized keys for starting image pickup, stopping im- 
age pickup, mode setting(s) and other basic operations. 
Further, regarding the power switch 16 and the opera- 
tion keys 18, operation elements such as a jog dial, a 
track ball and the like may be employed which may be 
of a slide switch and/or push-button switch type as 
shown in the Fig. 1 . 

[0018] The emergency switch 17 is provided for an 
emergency. It is preferable that a large operation button 
is employed for infallible operation thereby reducing the 
amount of time needed for checking the button in a sit- 
uation where time is of the essence. Further, it is pref- 
erable that either a certain level of pressing force is re- 
quired to operate the switch, or, as shown in the Fig. 1 , 
the surface of the button is set to a position which is 
recessed or one-step lower than the surface of the con- 
trol unit 10, to avoid erroneous operation of the switch. 
Besides a push-button type switch, various other forms 
of the emergency switch 1 7 can be such as an arrange- 
ment wherein the user's taps on the control unit 1 0 are 
detected, or the user's voice is recognized as an indica- 
tion of an emergency. 

[0019] The construction of the present video camera 
will be described later with reference to Fig. 5. If the user 
wears the present video camera (which comprises the 
camera unit 1 and the control unit 1 0 as described above 
and as shown in Fig. 2), hands-free image pickup can 
be realized. Accordingly, the camera may preferably be 
applicablefor image pickup of a work scene while a user 
is working, image pickup of an event or the like while the 
user enjoys the event, or image pickup during patrol by 
a security guard or police officer. 



[0020] The present video camera may perform the 
function of recording video data, obtained by image 
pickup, on to the memory card 30 and the function of 
transmitting the data. Fig. 4 shows an example of a sys- 
5 tern where these functions become effective such as for 
security and police purposes. 

[0021 ] The control unit 1 0 of the video camera is ca- 
pable of data communication with a management sta- 
tion 40 via a transmission medium such as a public line 

10 32 or the like. For this purpose, the control unit 10 has 
a communication function similar to that of a cellular 
phone, a personal handy phone system (PHS) or the 
like. Communication may also be realized by a special- 
ized line in place of the public line 32. 

15 [0022] The management station 40 comprises an or- 
ganization or the like to supervise and manage a 
number of police officers or security guards on patrol 
while wearing the present video camera. The manage- 
ment station has a controller 41 , a monitor 42, an oper- 

20 ation or control unit 43, a storage unit 44, a remote ac- 
cess server 45, a memory card slot 46 and the like. The 
controller 41 controls the system in the management 
station 40. The monitor 42 which may comprise a dis- 
play and a speaker or the like, outputs a video image 

25 and sound to an operator. The operation unit 43, which 
may include an operation tool such as a keyboard, a mi- 
crophone, a camera and the like, allows the operator to 
perform various operation inputs and information input. 
The storage unit 44, which may include an HDD (hard 

30 disk drive), an optical disk drive, a magnetic tape drive, 
or the like performs recording and reproduction of infor- 
mation to/from a recording medium. The remote access 
server 45 performs a communication operation between 
the management station 40 and the control unit 10 of 

35 the video camera via the public line 32. The memory 
card slot 46, which may be similar to card slot 1 3 in the 
control unit 10 of the video camera, is adaptable to re- 
ceive memory card 30 as the recording medium. The 
memory card 30 is made accessible by thecontroller41 . 

40 [0023] The control unit 10 held by the security guard 
or the like transmits video data (and sound data) ob- 
tained by the camera unit 1 . The data is transmitted to 
the management station 40 via the public line 32. The 
management station 40 stores the transmitted data in 

45 the storage unit 44 or outputs the data to the monitor 42, 
based on the control of the controller 41 . That is, in the 
management station 40, as the security guard patrols 
while holding the video camera, the operator on the 
management station side can check the video image 

50 and sound in the area where the security guard is pa- 
trolling; and the video image and sound picked up during 
the patrol may be stored. As such, the stored video im- 
age and sound can be utilized in inspection and analysis 
and used as evidence. Further, if it is publicly known that 

55 the video image (and the sound), obtained by image 
pickup by the video camera used by the security guard 
or the like, is monitored by the management station 40, 
crime prevention and improvement in safety of the se- 
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curity guard can be increased. 

[0024] The video image (and the sound) obtained by 
the security guard or the like with the video camera can 
be recorded on the memory card 30 inserted in the con- 
trol unit 10. The security guard orthelike can deliverthe 
memory card 30 to the management station 40 after his/ 
her patrol, which may be used as a patrol report. The 
management station 40 may put the delivered memory 
card 30 into the memory card slot 46, and read the video 
image and the sound recorded on the memory card 30 
by control of the controller 41 , so as to output the video 
image and the sound by the monitor 42 or store them in 
the storage unit 44. 

[0025] The management station 40 can transmit var- 
ious instruction information and data to the video cam- 
era (control unit 10). As described later, the station can 
transmit instruction information for selection of the rate 
for an image pickup operation to the control unit 10, 
based on the operator's operation by using the opera- 
tion unit 43, an operation program of the controller 41 
and the like. Further, the station can transmit security 
duty instructions as voice data, image data and/or text 
data, or can transmit image data and/or sound regarding 
a map, and/or a criminal's photograph or montage, as 
patrol information. Further, as described later, the sta- 
tion can transmit data on rate change condition such as 
a target sound or a target image to the control unit 1 0 of 
the video camera. 

[0026] The control unit 10 of the video camera may 
output the operator's instruction or information as sound 
from the speaker 14 or the headphone terminal 19 to 
the user. Further, the control unit 1 0 may display the im- 
age data and text data transmitted as instructions or in- 
formation on the display 1 1 , thereby presenting the data 
to the user. 

[0027] Although communication between the video 
camera and the management station 40 has been de- 
scribed herein, data communication may also be directly 
performed among a number of security guards or the 
like. For example, if the control unit 1 0 sends communi- 
cates in a manner similar to a cellular phone or a PHS, 
communication between security guards can be per- 
formed via a general public line. Alternatively, the man- 
agement station 40 may function as a so-called relay 
station to relay messages in between security guards. 
[0028] Further, the system shown in Fig. 4 has been 
described for security and police purposes, however, it 
can be applicable to other users. For example, a per- 
sonal computer at a user's home may operate similar to 
the management station 40, such that video image and 
sound obtained by the video camera can be transmitted 
and stored in a HDD orthe like of the personal computer 
at the user's home. 

[0029] In this manner, even if the user does not have 
the memory card 30 upon image pickup orthe capacity 
of the memory card is insufficient, the user can perform 
image pickup without knowing of such status. 



2. Construction of Video Camera 

[0030] Fig. 5 shows an example of the construction of 
the video camera. As described above, the camera unit 
5 1 is provided with the front camera 2a and the rear cam- 
era 2b. Light obtained by image pickup by the front cam- 
era 2a is converted to a video signal by a charge-cou- 
pled device (CCD) 5a. Then, predetermined signal 
processing such as gain control is performed, and the 
signal is supplied to the control unit 1 0 via the cable 31 . 
Similarly, light obtained by image pickup by the rear 
camera 2b is converted to a video signal by a CCD 5b. 
Then predetermined signal processing such as gain 
control is performed, and the signal is supplied to the 
control unit 1 0 via the cable 31 . Sound signals obtained 
by the front microphone 3a and the rear microphone 3b 
are supplied to the control unit 1 0 via the cable 31 . 
[0031] Further, a direction sensor 7 is provided in the 
camera unit 1 . The direction sensor 7 detects the direc- 
tion of the camera unit 1 . For example, the sensor de- 
tects one of east, west, south and north as a direction 
in which the camera unit 1 is directed, and supplies a 
direction detection signal to the control unit 10. 
[0032] In the control unit 10, a controller 51 controls 
operations. The controller 51 includes a microcomputer 
having a CPU, a RAM, a ROM, a flash ROM and/or the 
like. The video signal obtained by image pickup by the 
front camera 2a and the sound signal obtained by the 
front microphone 3a transmitted from the camera unit 1 
via the cable 31 are inputted into a storage encode unit 
53a and a communication encode unit 54a. Further, the 
video signal obtained by image pickup by the rear cam- 
era 2b and the sound signal obtained by the rear micro- 
phone 3b are inputted into a storage encode unit 53b 
and a communication encode unit 54b. The storage en- 
code units 53a and 53b perform, on the input video sig- 
nals obtained by image pickup (and the sound signals), 
data compression processing based on a predeter- 
mined compression method, frame extraction process- 
ing, and encode processing for conversion to a record- 
ing format for recording on to the memory card 30. A 
compression rate in the data compression processing 
and a frame rate in the frame extraction processing are 
controlled by a rate control signal CR from the controller 
51 . The outputs from the storage encode units 53a and 
53b are selected by a multiplexer 55, and supplied to a 
recording unit 57. The operation of the multiplexer 55 is 
controlled by a selection control signal CX from the con- 
troller 51. 

[0033] The recording unit 57 performs recording and 
reproduction with respect to the memory card 30 insert- 
ed in the memory card slot 13. The access operation 
thereof is controlled by a read/write control signal from 
the controller 51 . The recording unit 57 records the data, 
supplied via the multiplexer 55, on to the memory card 
30, based on the control of the controller 51 . According- 
ly, the video data with a level of quality is recorded on 
the memory card 30. Further, the recording unit 57 reads 
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video data (and sound data) recorded on the memory 
card 30 based on the control of the controller 51 . 
[0034] The video data and the sound data read from 
the memory card 30 are supplied to the controller 51 , 
and the controller 51 supplies the video data to the dis- 
play unit 11 fordisplay-outputorsupplies the sound data 
to either speaker 14 or headphone terminal 19 for audio 
output. Further, it may be arranged such that the video 
data and the sound data, read from the memory card 30 
by the recording unit 57, are subjected to decode 
processing by a decoder 58, then subjected to encode 
processing for communication by an encoder 59, and 
supplied to a transmission signal processor 60. 
[0035] The communication encode units 54a and 54b 
perform, on the input video signals obtained by image 
pickup (and the sound signals), data compression 
processing based on a predetermined compression 
method, frame extraction processing and encode 
processing for conversion to a communication format 
upon transmission-output. The compression rate in the 
data compression processing and frame rate in the 
frame extraction processing are controlled by a rate con- 
trol signal CR from the controller 51 . The outputs from 
the communication encode units 54a and 54b are se- 
lected by a multiplexer 56, and supplied to transmission 
signal processor 60. The operation of the multiplexer 56 
is controlled by the selection control signal CX from the 
controller 51 . 

[0036] When the video data (and the sound data) are 
supplied via the multiplexer 56, the transmission signal 
processor 60 performs modulation processing for trans- 
mission on the data, and supplies the data to a commu- 
nication unit 62. The communication unit 62 performs 
high-frequency modulation/amplification processing 
and the like, and performs data transmission from the 
antenna 12. The data transmission may occur at a con- 
stant rate or at variable rates. The transmitted data may 
be received by the management station 40. 
[0037] Accordingly, the video data with a level of qual- 
ity is transmitted to the management station 40. Then, 
in the management station 40, the scene and sound of 
the surroundings of the security guard or the like, and/ 
or the voice of the security guard himself/herself can be 
monitored. 

[0038] Further, in a case where video data and/or 
sound data, reproduced from the memory card 30 by 
the recording unit 57, as described above, is supplied 
to the transmission signal processor 60, the transmis- 
sion signal processor 60 performs modulation process- 
ing for transmission on the video data (and the sound 
data). Then the communication unit 62 performs high- 
frequency modulation/amplification processing or the 
like, and data transmission is performed from the anten- 
na 12 to the management station 40. Accordingly, the 
video data with a level of quality based on the compres- 
sion rate and the frame rate recorded on the memory 
card 30, is transmitted to the management station 40. 
[0039] The controller 51 can transmit notification in- 



formation, otherthan the video and sound data obtained 
by image pickup or reproduction, to the management 
station 40. For example, when the emergency switch 1 7 
has been operated, notification information such as one 

5 or more of notification of occurrence of emergency, cur- 
rent position information, ID and the like, may be sup- 
plied to the encoder 59 and processed thereat. Then, 
this processed notification information may be transmit- 
ted to the management station 40 by way of the trans- 

10 mission signal processor 60 andthecommunication unit 
62. The current position information is position informa- 
tion obtained by a (GPS) antenna 66 and GPS decoder 
65. Further, the ID is an ID uniquely assigned to the vid- 
eo camera and stored in the flash ROM of the controller 

15 51. 

[0040] The instruction information and various data, 
transmitted from the management station 40, may be 
received by the antenna 12, then subjected to high-fre- 
quency demodulation, amplification and the like by the 

20 communication unit 62, and decoded by a reception sig- 
nal processor 61 . Then the data is supplied to the con- 
troller 51 or the recording unit 57. The controller 51 per- 
forms a control operation or operations in correspond- 
ence with the received instruction information. 

25 [0041] Further, in a case where image data, sound da- 
ta, and/or text data and the like are transmitted from the 
management station 40, the received information may 
be provided to the user by the display unit 11 or the 
speaker 14, or recorded on the memory card 30 in the 

30 recording unit 57. 

[0042] The operations of thetransmission signal proc- 
essor 60, the reception signal processor 61 and the 
communication unit 62 are controlled by a communica- 
tion control signal CT supplied from the controller 51 . 

35 The controller 51 may control call and line connection 
processing, data transmission/reception processing 
and the like to perform communication. Then regarding 
the transmission signal processor 60, the reception sig- 
nal processor 61 and the communication unit 62, com- 

40 munication utilizing a public line network generally used 
can be performed by adopting a processing method 
used in a cellular phone or PHS or the like. The data 
transmission destination and data reception destination 
in the communication function may not be necessarily 

45 the management station 40. For example, communica- 
tion may be performed with the control unit 10 of the 
video camera of another security guard or the like. 
[0043] The operation keys 1 8 enable a number of op- 
erations to be performed and are provided on the case 

50 of the control unit 1 0 as previously described with refer- 
ence to Fig. 1 . For example, the controller 51 may dis- 
play a menu of various operations on the display unit 
11 , and the user may perform an operation input on the 
menu by cursor operation or enter an operation using 

55 the operation keys 1 8. The controller 51 performs pre- 
determined control corresponding to the operation sup- 
plied by the user using the operation keys 1 8. As such, 
the controller may perform various control for starting/ 
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stopping an image pickup operation, an operation 
mode, recording/reproduction, communication, rate 
control and/orthe like, in correspondence with the user's 
operation. The operation keys 18 may not necessarily 
be operation elements corresponding to the operation 
menu on the display unit 1 1 . Alternatively, the keys may 
be provided as discrete function keys such as an image- 
pickup start key, a stop key, a mode key and the like. 
[0044] The control unit 10 may also include GPS an- 
tenna 66 and GPS decoder 65. The GPS antenna 66 
receives a signal from a GPS (Global Positioning Sys- 
tem) satellite. The GPS decoder 65 decodes the re- 
ceived signal, and outputs latitude and longitude as cur- 
rent position information. The controller 51 can grasp a 
current position from the latitude and longitude data 
from the GPS decoder, and determine whether or not 
the current position is within a predetermined area, or 
transmit the current position information. 
[0045] Further, as described above, the direction sen- 
sor 7 is provided in the camera unit 1 , and direction in- 
formation is supplied to the controller 51 . Using this in- 
formation, the controller 51 can detect a current image 
pickup direction of the front camera 2a and of the rear 
camera 2b. 

[0046] If the emergency switch 1 7 has been operated, 
the controller 51 performs emergency processing. In 
such situation, the controller may perform transmission 
control for emergency notification, ID notification and/or 
notification of the current position information obtained 
from the GPS decoder 65, to the management station 
40 or the like. 

[0047] The control unit 10 may also include a shock 
sensor 67. The shocksensor 67 outputs a detection sig- 
nal to the controller 51 in a case where a shock applied 
from the outside to the user orthe control unit 10 is equal 
to or higher than a predetermined level. It may be ar- 
ranged such that, upon detection of shock, the controller 
51 performs transmission control for emergency notifi- 
cation, ID notification and/or notification of the current 
position information obtained from the GPS decoder 65, 
to the management station 40 or the like, so as to pro- 
vide an indication of an emergency. 
[0048] The display unit 11 performs various display 
operations by control of thecontroller51 . That is, display 
of operation menu, display of operation status, display 
of image, text and the like received from the manage- 
ment station 40 orthe like, display of video image repro- 
duced from the memory card 30 by the recording unit 
57, and the like may be performed. In addition to dis- 
playing video signals obtained by image pickup by the 
front camera 2a and the rear camera 2b, image pickup 
status can be performed and displayed on the display 
unit 11. 

[0049] Various sounds may be outputted from the 
speaker 14 (and the headphoneterminal 19) by thecon- 
trol of the controller51 . Such sounds may include sound 
output based on sound data received from the manage- 
ment station 40 or the like, alarm output, output of in- 



coming-tone notifyingthe user of data reception, andthe 
like. Further, sound monitoring output upon image 
pickup can be performed. 

[0050] In the cable connection terminal 15, datatrans- 
5 mission based on a predetermined interface standard is 
possible by cable connection with an external informa- 
tion device. For example, uploading for a version up- 
grade of an operation program of the controller 51 , 
transmission of data reproduced from the memory card 
30 to an external device, and/or data loading of data as 
a target sound or target image to be described later, are 
possible. 

[0051] The control unit 1 0 may also include an image 
analysis unit 63. Video signals, obtained by image pick- 
up by the front camera 2a and the rear camera 2b, are 
supplied to the image analysis unit 63, and the unit per- 
forms various analysis processing on the supplied re- 
spective video signals obtained by image pickup. Exam- 
ples of such processing may include detecting the mo- 
tion of a subject by comparing processing between 
frames of the video signal, and when a particular image 
such as a particular color, building, scene or person is 
set by the controller 51 as a target image, detecting 
whether or not an obtained image corresponds to the 
target image. Detection information from the image 
analysis unit 63 is outputted to the controller51 , and the 
controller 51 performs predetermined control such as 
rate control in correspondence with the detection infor- 
mation. 

[0052] Further, the control unit 1 0 may also include a 
sound check unit 64. Sound signals, picked up by the 
front microphone 3a and the rear microphone 3b, are 
supplied to the sound check unit 64 which performs 
check processing thereon. Such check processing may 
be performed on the respective sound signals from the 
front microphone 3a and the rear microphone 3b to de- 
termine whether or not a sound volume level is equal to 
or greater than a predetermined value. In this case, de- 
tection as to whether a large sound volume has occurred 
in the front direction or rear direction, is performed from 
the difference between front/rear sound volumes, delay 
status and the like. Further, a particular sound, for ex- 
ample, an alarm sound such as emergency bell, an ex- 
plosion, an accident, a sound of a vehicle, or a particular 
person's voice print may be set as a target sound by the 
controller 51 , and processing to detect whether or not 
an inputted sound (which corresponds to or which is 
similar to the target sound) may be performed. In this 
case, a determination may be performed as to whether 
a target sound has occurred in the front direction or rear 
direction, which may involve the sound signals from the 
front microphone 3a and the rear microphone 3b, is per- 
formed from the difference between front/rear sound 
volumes, delay status and the like. Information from the 
check processing may be supplied to the controller 51 , 
and the controller 51 performs predetermined control 
such as rate control, in correspondence with such infor- 
mation. 
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[0053] When the power switch 1 6 is placed in the on- 
state, a power source 52 starts an operation to supply 
an operation power-supply voltage VDD to the respec- 
tive units, and turns the video camera into a power-on 
status. The power source 52 includes a battery such as 
a dry cell or a charging battery, and supplies power to 
the respective units. When the camera goes into the 
power-on status and the power-supply voltage VDD is 
supplied, the light emission unit 4 in the camera unit 1 
starts emitting light in a manner as previously described. 
[0054] On the camera unit 1 side, the image pickup 
and sound pickup operations may be performed when 
the camera goes into the power-on status and the pow- 
er-supply voltage VDD is supplied. That is, in such sit- 
uation, the camera may go into a mode where video sig- 
nals and sound signals obtained by image pickup are 
outputted to the control unit 10. In this case, recording/ 
transmission on/to the memory card 30 may not be per- 
formed. Instead, a monitor video image may be output- 
ted to the display unit 11 . Further, recording and trans- 
mission may not actually be performed until the user has 
performed an image-pickup start operation by using the 
operation keys 18. 

[0055] Additionally recording and transmission of vid- 
eo signals obtained by image pickup and sound signals 
may be performed when the camera goes into power- 
on status or mode. That is, the operation can be simpli- 
fied such that the image pickup operation including re- 
cording and transmission is started by the user turning 
the power on with the power switch 1 6. Further, the light 
emission by the light emission unit 4 may be controlled 
by the controller 51 such that light emission occurs dur- 
ing a period in which thecamera is in the power-on mode 
and recording or transmission is performed. The con- 
troller 51 may also detect the operation of the power 
switch 16 and cause the power source 52 to start the 
power supply in correspondence with the detection. 
[0056] Although the present video camera has been 
described with the above construction, various modifi- 
cations such as those described below can be made 
thereto. 

[0057] The outer appearance of the camera unit 1 and 
the control unit 10 and the arrangement and the shape 
of the operation elements for user interface and display 
are not limited to that previously described. Alternative- 
ly, various other shapes and/or arrangements may be 
utilized. 

[0058] Instead of the camera unit 1 and the control 
unit 10 being interconnected via the cable 31, radio 
transmission of video signals obtained by image pickup 
and sound signals may be performed by a transmitter 
utilizing a radio wave, infrared radiation or the like. 
[0059] Additionally, the camera unit 1 and the control 
unit 1 0 may not be separate units, but may be integrally 
formed. 

[0060] The present video camera has the front cam- 
era 2a and the rear camera 2b. However, the camera 
may have three or more cameras and the respective 



cameras may perform image pickup in different direc- 
tions. 

[0061 ] Respective microphones may be provided cor- 
responding to the two or more cameras. Further, a mi- 
5 crophone shared by all or a part of the respective cam- 
eras may be provided. As long as at least one micro- 
phone is provided, the video camera may pickup sound. 
[0062] Further, a pan/tilt mechanism may be provided 
for one or more of the cameras such that the image pick- 
up direction may be changed in an upward/downward/ 
leftward/rig htward direction. 

[0063] Image pickup may be performed in more than 
the two directions previously described. For example, 
image pickup may be performed in various directions 
such as frontward, rearward, leftward, rightward, up- 
ward, downward and/or the like. The multiple cameras 
can also be arranged such that one or more of the cam- 
eras may be panned/tilted, and the user can set the im- 
age pickup directions of the respective cameras. 
[0064] Further, it is conceivable that image pickup 
may almost be performed simultaneously in plural direc- 
tions by providing one camera with a mechanism for 
changing an image pickup direction at high-speed. 
[0065] The camera unit 1 may also include multiple 
light emission units. 

[0066] Although the present video camera may use 
the memory card 30, a disk drive device, for example, 
an optical disk or a magneto-optical disk, may be pro- 
vided in the control unit 1 0, and a video image obtained 
by image pickup may be recorded on a disk recording 
medium. Alternatively, a magnetic tape medium may al- 
so be used as the recording medium. 
[0067] Not all the elements shown in Fig. 5 may be 
used in the present video camera, and other elements 
than those may be added. Additionally, the storage en- 
code units and the communication encode units may be 
formed as one circuit unit. 

[0068] Further, the data obtained by the video camera 
may be only transmitted and not recorded. Alternatively, 
the obtained data may only be recorded and not trans- 
mitted. 

[0069] The image analysis unit 63, the sound check 
unit 64, the emergency switch 1 7, the GPS antenna 66 
and the GPS decoder 65, and the shock sensor 67 may 
detect a rate change condition used for rate control 
(which will be described later), however, not all the units 
may detect the rate change condition. Further, the rate 
change condition may also be detected by a tempera- 
ture sensor, an acceleration sensor and/or the like. 
[0070] When the camera is used for purposes other 
than security purposes, the emergency switch 17 may 
be omitted. 

[0071] Further, a short-distance radio communication 
function such as Bluetooth™, other device interface 
functions and user interface functions and the like, may 
be provided. 
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3. Image Pickup Operation Mode 

[0072] As shown in Fig. 6, an image pickup operation 
of the present video camera may be performed in one 
of a storage mode, a transmission mode, and a multi 
mode. The storage mode may record data obtained by 
the video camera on the memory card 30 but may not 
transmit the data to the management station 40. The 
transmission mode may transmit the data obtained by 
the video camera to the management station 40 but may 
not record the data on to the memory card 30. The multi 
mode may record the obtained data on the memory card 
30 and/or transmit the data to the management station 
40. 

[0073] The mode may be changed, for example, by 
mode-control instruction information transmitted by the 
management station 40 or by using the operation keys 
18. If a different mode is desired, the controller 51 may 
perform the mode change. However, the present video 
camera may be constructed such that only one of the 
previously described modes may be used for image 
pickup. On the other hand, the camera may also be con- 
structed such that one of two possible modes (i.e., the 
multi mode and the transmission mode, the multi mode 
and the storage mode, or the storage mode and the 
transmission mode) may be selected to perform the im- 
age pickup operation. In any one of the modes, the con- 
troller 51 may perform rate control on the storage en- 
code units 53a and 53b or the communication encode 
units 54a and 54b. The rate may be changed to one of 
a normal rate, a front priority rate and a rear priority rate. 
[0074] In the normal rate, video data obtained by the 
front camera 2a and the rear camera 2b have the same 
quality. That is, in the normal rate, the frame rate used 
in the frame extraction processing by the storage en- 
code unit 53a and the communication encode unit 54a 
on a video signal obtained from the front camera 2a may 
be controlled such that the same frame rate may be 
used in the frame extraction processing by the storage 
encode unit 53b and the communication encode unit 
54b on a video signal obtained from the rear camera 2b. 
Further, in the normal rate, the compression rate used 
in the data compression processing by the storage en- 
code unit 53a and the communication encode unit 54a 
on a video signal obtained from the front camera 2a may 
be controlled such that the same compression rate may 
be used in the data compression processing by the stor- 
age encode unit 53b and the communication encode 
unit 54b on a video signal obtained from the rear camera 
2b. 

[0075] Accordingly, in the multi mode and the storage 
mode, if the normal rate is set, the video data obtained 
by the front camera 2a and the rear camera 2b and re- 
corded on the memory card 30 have the same quality. 
Further, in the multi mode and the transmission mode, 
if the normal rate is set, the video data obtained by the 
front camera 2a and the rear camera 2b and transmitted 
to the management station 40 or the like have the same 



quality. 

[0076] In the front priority rate, video data obtained by 
the front camera 2a has a higher quality than video data 
obtained by the rear camera 2b. That is, in the front pri- 

5 ority rate, the frame rate used in the frame extraction 
processing by the storage encode unit 53a and the com- 
munication encode unit 54a on a video signal obtained 
from the front camera 2a may be higher than the frame 
rate used in the frame extraction processing by the stor- 

10 age encode unit 53b and the communication encode 
unit 54b on a video signal obtained from the rear camera 
2b. Further, the compression rate used in the data com- 
pression processing by the storage encode unit 53a and 
the communication encode unit 54a on a video signal 

15 obtained from the front camera 2a may be lower than 
the compression rate used in the data compression 
processing by the storage encode unit 53b and the com- 
munication encode unit 54b on a video signal obtained 
from the rear camera 2b. 

20 [0077] Accordingly, in the multi mode and the storage 
mode, if the front priority rate is set, video data obtained 
by the front camera 2a may have a higher quality than 
video data obtained by the rear camera 2b which may 
be recorded on the memory card 30. Further, in the multi 

25 mode and the transmission mode, if thefront priority rate 
is set, video data obtained by the front camera 2a may 
have a higher quality than video data obtained by the 
rear camera 2b which may be transmitted to the man- 
agement station 40 or the like. 

30 [0078] In the rear priority rate, video data obtained by 
the rear camera 2b has a higher quality than video data 
obtained by the front camera 2a. That is, in the rear pri- 
ority rate, the frame rate used in the frame extraction 
processing by the storage encode unit 53b and the com- 

35 munication encode unit 54b on a video signal obtained 
from the rear camera 2b may be higher than the frame 
rate used in the frame extraction processing by the stor- 
age encode unit 53a and the communication encode 
unit 54a on a video signal obtained from the front cam- 

40 era 2a. Further, the compression rate used in the data 
compression processing by the storage encode unit 53b 
and the communication encode unit 54b on a video sig- 
nal obtained from the rear camera 2b maybe lower than 
the compression rate used in the data compression 

45 processing by the storage encode unit 53a and the com- 
munication encode unit 54a on a video signal obtained 
from the front camera 2a. 

[0079] Accordingly, in the multi mode and the storage 
mode, if the rear priority rate is set, video data obtained 

50 by the rear camera 2b may have a higher quality than 
video data obtained by the front camera 2a which may 
be recorded on the memory card 30. Further, in the multi 
mode and the transmission mode, if the rear priority rate 
is set, video data obtained by the rear camera 2b may 

55 have a higher quality than video data obtained by the 
front camera 2a which may be transmitted to the man- 
agement station 40 or the like. 

[0080] Figs. 7(a)-7(c) schematically shows a frame 
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rate change. For example, Fig. 7(a) shows frame extrac- 
tion timing on a video signal obtained by the front cam- 
era 2a and frame extraction timing on a video signal ob- 
tained by the rear camera 2b for the normal rate. In this 
case, regarding both front video image and rear video 
image, video data can be obtained at an equal frame 
rate, such as x frames, within a unit period such as one 
second. 

[0081 ] Fig. 7(b) shows a case of the front priority rate. 
Within the unit period, such as one second, the number 
of frames extracted from the video signal obtained by 
the front camera 2a may be larger than the number of 
frames extracted from the video signal obtained by the 
rear camera 2b. That is, the resolution of the front video 
image may be increased in a time-sequential direction, 
thereby improving the quality of the front video image. 
[0082] Further, Fig. 7(c) shows a case of the rear pri- 
ority rate. Within the unit period, such as one second, 
the number of frames extracted from the video signal 
obtained by the rear camera 2b may be larger than the 
number of frames extracted from the video signal ob- 
tained by the front camera 2a. That is, the resolution of 
the rear video image may be increased in a time-se- 
quential direction, thereby improving the quality of the 
rear video image. 

[0083] The actual number of frames extracted in the 
unit period in the respective front priority rate and the 
rear priority rate can be set to various values as a matter 
of design. The design may be made in correspondence 
with, among other things, a transfer-clock frequency in 
the CCD units 5a and 5b, desired image quality, and the 
like. 

[0084] As described above, increasing the frame rate 
improved the video quality. Alternatively, video data at 
a lower compression rate has higher video quality. 
[0085] In the examples of Figs. 7(a)-7(c), as a whole, 
the same rate may be set. That is, the total number of 
frames extracted within the unit period may be the same 
in the normal rate, the front priority rate, and/or the rear 
priority rate. For example, in Fig. 7(a) where x frames 
are extracted from front and rear video images within 
the unit period, the total number of frames extracted may 
be2x. Further, the total number of frames extracted may 
also be 2x as shown in Figs. 7(b) and 7(c). Alternatively, 
in the front priority rate and the rear priority rate, the en- 
tire frame rate may be higher than the normal rate, as 
shown in Figs. 8(a)-8(c). 

[0086] As shown in Fig. 8(a), where frame extraction 
timing from the front and rear video images may be at 
the normal rate, y frames are extracted from the front 
and rear video images within the unit period and the total 
number of frames may be 2y. In the case of the front 
priority rate as shown in Fig. 8(b) and in the case of the 
rear priority rate as shown in Fig. 8(c), the number of 
total frames at the front and rear rates is larger than 2y. 
Further, even at the front priority rate, the frame rate for 
the rear camera 2b may be higher than the frame rate 
for the rear camera 2b at the normal rate. Also, even at 



the rear priority rate, the frame rate for the front camera 
2a may be higher than the frame rate for the front cam- 
era 2a at the normal rate. That is, at either the front pri- 
ority rate or the rear priority rate, the image quality of 

5 both front and rear video images may be higherthan the 
image quality of both front and rear video images at the 
normal rate. Further, the image quality of one of the front 
video image and the rear video image may be higher 
than the other video image. 

10 [0087] Also, as shown in Figs. 9(a)-9(c), at the front 
and rear priority rates, the entire frame rate may be high- 
er than the normal rate. As shown in Fig. 9(a), where 
frame extraction timing from the front and rear video im- 
ages may be at the normal rate, y frames are extracted 

15 from the front and rear video images within the unit pe- 
riod and the total number of frames may be 2y. In the 
front priority rate, as shown in Fig. 9(b), and in the rear 
priority rate, as shown in Fig. 9(c), the number of total 
frames at the front and rear rates may be larger than 2y. 

20 [0088] However, at the front priority rate the frame rate 
for the rear camera 2b may be lower than the normal 
rate. Additionally, at the rear priority rate, the frame rate 
for the front camera 2a may be lower than the normal 
rate. As a result, in the front priority rate and the rear 

25 priority rate, the image quality may be improved for the 
video image with priority. 

[0089] It may be arranged such that at the front priority 
rate, the number of frames in the unit period may be zero 
in the communication encode unit 54b and the storage 

30 encode unit 53b for a rear video image. Similarly, at the 
rear priority rate, the number of frames in the unit period 
may be zero in the communication encode unit 54a and 
the storage encode unit 53a for a front video image. 
[0090] In this manner, various methods can be used 

35 for frame rate control at the normal rate, the front priority 
rate and the rear priority rate and similarly, various meth- 
ods can be used for compression rate change. Accord- 
ingly, Fig. 10 shows various aspects of a rate control 
method. As can be seen in Fig. 1 0, "f1 "to "f7" are exam- 

40 pies of aspects of frame rate control at the front priority 
rate and the rear priority rate. Further, "ml" to "m5" in 
Fig. 10 are examples of aspects of compression rate 
control at the front priority rate and the rear priority rate. 
The terms "increased", "reduced" and "not changed" 

45 mean that "the rate is increased", "the rate is decreased" 
and "the rate is not changed" respectively, with the nor- 
mal rate as a reference rate. Further, "front frame rate" 
and "front compression rate" indicate that rate control 
may be performed on the storage encode unit 53a and 

50 the communication encode unit 54a, and "rear frame 
rate" and "rear compression rate" indicate that rate con- 
trol may be performed on the storage encode unit 53b 
and the communication encode unit 54b. 
[0091] An example of the contents of "f1 " to "f7" are 

55 as follows: 

<f1 > - The total rate may be constant at the normal 
rate, the front priority rate and the rear priority rate. 
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At the front priority rate, the front frame rate may be 
increased, and the rear frame rate may be reduced. 
At the rear priority rate, the front frame rate may be 
reduced, and the rear frame rate may be increased. 
<f2> - The total rate may be higher than the normal 5 
rate at t h e fro nt p ri o rity rate an d th e rear p riority rate . 
At the front priority rate, the front frame rate may be 
increased, and the rear frame rate may not be 
changed. At the rear priority rate, the front frame 
rate may not be changed, and the rear frame rate 10 
may be increased. That is, this control corresponds 
to the example where one of the rates may be in- 
creased, to improve quality. 
<f3> - The total rate of the front priority rate and the 
rear priority rate may be higherthan the normal rate. 15 
At the front priority rate, the front and rear frame rate 
may be increased and the front frame rate may be 
higher than the rear frame rate. At the rear priority 
rate, the front and rear frame rate may be increased 
and the rear front frame rate maybe higherthan the 20 
front frame rate. That is, one of the rates may be 
increased more than the other rate to improve qual- 
ity. 

<f4> - The total rate may be higher than the normal 
rate at the front priority rate and the rear priority rate. 25 
At the front priority rate, the front frame rate may be 
greatly increased, and the rear frame rate may be 
reduced. At the rear priority rate, the front frame rate 
may be reduced, and the rear frame rate may be 
greatly increased. That is, this control corresponds 30 
to the example where the quality at the one of the 
rates with higher priority may be greatly improved, 
as shown in Fig. 9. 

<f5> - The total rate may be lower than the normal 
rate at the front priority rate and the rear priority rate. 35 
At the front priority rate, the front frame rate may not 
be changed, and the rear frame rate may be re- 
duced. At the rear priority rate, the front frame rate 
may be reduced, and the rear frame rate may not 
be changed. That is, the quality of the video image 40 
may be higher at the rate with a higher priority by 
lowering the quality at the other rate with a lower 
priority. 

<f6> - The total rate may be lower than the normal 
rate at the front priority rate and the rear priority rate. 45 
At the front priority rate, the front frame rate and the 
rear frame rate may be reduced and the front frame 
rate may be higher than the rear frame rate. At the 
rear priority rate, the front frame rate and the rear 
frame rate may be reduced and the rear frame rate 50 
may be higher than the front frame rate. That is, to 
improve quality, the rate of reduction may be low- 
ered. 

<f7> - The total rate may be lower than the normal 
rate at the front priority rate and the rear priority rate. 55 
At the front priority rate, the front frame rate may be 
reduced, and the rear frame rate may be greatly re- 
duced. At the rear priority rate, the front frame rate 



may be greatly reduced, and the rear frame rate 
may be reduced. That is, the quality at the rate with 
a higher priority may be relatively improved by 
greatly reducing the other rate with a lower priority. 

[0092] An example of the contents of "ml " to M m5" are 
as follows: 

<m1 > - At the front priority rate, the front compres- 
sion rate may be reduced and the rear compression 
rate may be increased. At the rear priority rate, the 
front compression rate may be increased and the 
rear compression rate may be reduced. That is, to 
improve quality for a rate with a higher priority, the 
higher priority rate may be reduced (lower compres- 
sion rate improves quality) and the other rate may 
be increased. 

<m2> - At the front priority rate, the front compres- 
sion rate may be reduced and the rear compression 
rate may not be changed. At the rear priority rate, 
the front compression rate may not be changed and 
the rear compression rate may be reduced. That is, 
to improve quality, one of the rates may be reduced. 
<m3> - At the front priority rate, the front compres- 
sion rate may not be changed and the rear com- 
pression rate may be increased. At the rear priority 
rate, the front compression rate may be increased 
and the rear compression rate may not be changed. 
That is, the quality of one of the rates with a higher 
priority may be improved by lowering the quality of 
the other rate. 

<m4> - At the front priority rate, the front compres- 
sion rate and the rear compression rate are re- 
duced. The front compression rate may be lower 
than the rear compression rate. At the rear priority 
rate, the front compression rate and the rear com- 
pression rate are reduced. In this case, the rear 
compression rate may be lower than the front com- 
pression rate. That is, the reduction rate for one of 
the rates is greater than the reduction rate for the 
other rate thereby improving the quality of the rate 
with a higher priority. 

<m5> - At the front priority rate, the front compres- 
sion rate and the rear compression rate are in- 
creased. The front compression rate may be lower 
than the rear compression rate. At the rear priority 
rate, the front compression rate and the rear com- 
pression rate are increased. In this case, the rear 
compression rate may be lower than the front com- 
pression rate. That is, the reduction rate of one of 
the rates may be lower than the reduction rate of 
the other rate. 

[0093] In this manner, regarding the frame rate, the 
control aspects of f 1 to f7 may be employed, and regard- 
ing the compression rate, the control aspects of ml to 
m5 may be employed. Any one of f 1 to f7 and ml to m5 
can be considered as a rate control method when the 
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rate is changed to the front priority rate or the rear pri- 
ority rate. 

[0094] For example, where only the frame rate 
change may be performed (the compression rate may 
be fixed), any one of the rate control methods f1 to f7 
may be employed. Further, in a case where only com- 
pression rate change may be performed (the frame rate 
may be fixed), any one of the rate control methods ml 
to m5 may be employed. Further, in a case where both 
the frame rate and the compression rate may be 
changed, a combination of one of the control methods 
f1 to f7 and one of the control methods ml to m5 may 
be employed as the rate control method. 
[0095] In any of the above rate control methods, con- 
trol may be performed such that the compression rate 
with higher priority may be lower than the other com- 
pression rate. Alternatively, control may be performed 
such that the frame rate in the frame extraction process- 
ing with a higher priority may be higher than the other 
frame rate in the frame extraction processing. 

4. Rate Change by Operation or Instruction 

[0096] As described above, the controller51 may con- 
trol the rate to change the frame rate and/or the com- 
pression rate on the storage encode units 53a and 53b 
and the communication encode units 54a and 54b. For 
this purpose, the controller 51 detects various rate 
change conditions and may control the rate change cor- 
responding to the detected rate change condition. 
[0097] Hereinbelow, respective examples of process- 
ing regarding the rate change control by the controller 
51 will be described. 

[0098] First, processing performed by the controller 
51 to control the rate change in accordance with the us- 
er's operation or an instruction from the management 
station 40 will be described with reference to Fig 1 1 . The 
processing in Fig. 1 1 (as well as Figs. 12,13 and 1 4 to 
be described later) is an example of rate change control 
performed by the controller 51 upon execution of the im- 
age pickup operation which may occur in an operation 
mode where data may be recorded on the memory card 
30 and/or transmitted. 

[0099] In Fig. 1 1 , at the start of the image pickup op- 
eration (recording/transmission), the controller 51 in- 
structs the respective encode units 53a, 53b, 54a and 
54b to set the normal rate, as shown in step F1 01 . That 
is, the controller 51 may set the frame rate and the com- 
pression rate for the storage encode unit 53a and the 
communication encode units 54aandtheframe rate and 
the compression rate for the storage encode unit 53b 
and the communication encode unit 54b at the same 
rate. In this case, the controller 51 may detect rate 
change conditions at steps F1 02 to F1 05. 
[0100] At step F102, the controller 51 may monitor 
whether or not the user has performed a change oper- 
ation to change the rate to the front priority rate. At step 
F1 03, it monitors whether or not the rate change instruc- 



tion to change the rate to the front priority rate has been 
received from the management station 40. Further, at 
step F1 04, the controller 51 may monitor whether or not 
the user has performed a change operation to change 

5 the rate to the rear priority rate. At step F1 05, it monitors 
whether or not a rate change instruction to change the 
rate to the rear priority rate has been received from the 
management station 40. If these rate change conditions 
are not detected, the controller returns to step F101 

10 where it continues the image pickup operation at the 
normal rate. 

[0101] If an operation or instruction to change the rate 
to the front priority rate has been detected at step F1 02 
or F1 03, the controller 51 proceeds to step F1 06, where 

15 image pickup (recording/transmission) may be per- 
formed at the front priority rate. That is, the frame rate 
and/or the compression rate for the storage encode unit 
53a and the communication encode unit 54a may be 
higher than the frame rate and/or lower than the com- 

20 pression rate for the storage encode unit 53b and the 
communication encode unit 54b. This may set a status 
where video data obtained by the front camera 2a, has 
a higher quality than video data obtained by the rear 
camera 2b. 

25 [0102] During a period where image pickup may be 
performed at the front priority rate, the controller 51 may 
detect the rate change condition at steps F1 07 to F11 0. 
At step F1 07, the controller monitors whether or not the 
user has performed the change operation to change the 

30 rate to the normal rate. At step F108, it monitors whether 
or not the rate change instruction to change the rate to 
the normal rate has been received from the manage- 
ment station 40. Further, at step F1 09, the controller 51 
may monitor whether or not the user has performed the 

35 change operation to change the rate to the rear priority 
rate. At step F110, it monitors whether or not the rate 
change instruction to change the rate to the rear priority 
rate has been received from the management station 
40. If these rate change conditions are not detected, the 

40 controller returns to step F106 where it continues the 
image pickup operation at the front priority rate. 
[0103] If an operation or instruction to change the rate 
to the rear priority rate has been detected at above step 
F1 04 or F1 05, the controller 51 proceeds to step F1 1 1 

45 where the image pickup (recording/transmission) may 
be performed at the rear priority rate. That is, the frame 
rate and/or the compression rate for the storage encode 
unit 53b and the communication encode unit 54b may 
be higherthan the frame rate and/or lowerthan the com- 

50 pression rate for the storage encode unit 53a and the 
communication encode unit 54a. As such, video data 
obtained by the rear camera 2b, has a higher quality 
than video data obtained by the front camera 2a. 
[0104] During a period where image pickup may be 

55 performed at the rear priority rate, the controller 51 may 
detect the rate change condition at steps F1 1 2 to F1 1 5 . 
At step F1 1 2, the controller 51 may monitor whether or 
not the user has performed the change operation to 
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change the rate to the normal rate. At step F11 3, it mon- 
itors whether or not the rate change instruction to 
change the rate to the normal rate has been received 
from the management station 40. Further, at step F1 1 4, 
the controller 51 may monitor whether or not the user 
has performed the change operation to change the rate 
to the front priority rate. At step F115, it monitors whether 
or not the rate change instruction to change the rate to 
the front priority rate has been received from the man- 
agement station 40. If these rate change conditions are 
not detected, the controller returns to step F111 where 
it continues the image pickup operation at the rear pri- 
ority rate. 

[0105] If the change operation or the change instruc- 
tion from the management station 40 to change the rate 
to the normal rate has been detected at any of steps 
F1 07, F1 08, F1 1 2 and F11 3, the controller proceeds to 
step F101 , at which the controller 51 performs control 
to change the rate to the normal rate. That is, the con- 
troller controls the frame rate and the compression rate 
for the storage encode unit 53a and the communication 
encode unit 54a, and the frame rate and the compres- 
sion rate for the storage encode unit 53b and the com- 
munication encode unit 54b so as to be equal. At step 
F1 09 or F1 1 0, if the change operation or the change in- 
struction to change the rate to the rear priority rate has 
been detected, the controller proceeds to step F111 
where the controller 51 may change the rate to the rear 
priority rate. At step F1 1 4 or F1 1 5, if the change opera- 
tion or the change instruction to change the rate to the 
front priority rate has been detected, the controller pro- 
ceeds to step F1 06 where the controller 51 may change 
the rate to the front priority rate. 
[0106] As described above, the controller51 may con- 
trol the compression rate in the data compression 
processing and the frame rate in the frame extraction 
processing in the respective encode units 53a, 53b, 54a 
and 54b to change the rate to the normal rate, the rear 
priority rate or the front priority rate. Accordingly, if the 
user wants to record/transmit high-quality video data for 
a front scene, the user may perform the change opera- 
tion to change the rate to the front priority rate by using 
the operation keys 18. If the user wants to record/trans- 
mit high-quality video data for a rear scene, the user may 
perform the change operation to change the rate to the 
rear priority rate by using the operation keys 18. 
[0107] Further, an operator at the management sta- 
tion 40 monitoring data transmitted from the video cam- 
era, can change the rate to the front priority rate or the 
rear priority rate at a desired point. As an example, when 
the operator wants to carefully check either the front or 
rear of the video image or when the operator's attention 
is attracted by something that was ignored by the user, 
the operator can instruct the video camera to change 
the rate to the front priority rate or the rear priority rate. 
As such, more detailed video information can be ob- 
tained by the management station 40, thereby improv- 
ing security. 



[01 08] Further, the present video camera may be pro- 
vided with the emergency switch 1 7 as described above. 
For example, upon occurrence of an incident, accident, 
and/or criminal pursuit, the user may depresses the 

5 emergency switch 1 7. As described above, the emer- 
gency switch 17 may be a large switch which the user 
can easily operate. When the emergency switch 1 7 has 
been operated, the controller 51 supplies data notifying 
the occurrence of an emergency, the video camera ID, 

10 and the current position information detected by the 
GPS decoder 65 to the encoder 59. The data is proc- 
essed by the transmission signal processor 60 and the 
communication unit 62 and transmitted to the manage- 
ment station 40 by way of antenna 12. Transmitting the 

15 data indicative of an emergency, informs the operator of 
an emergency so that the operator may pay attention to 
the video image being transmitted from the video cam- 
era. 

[01 09] In the above case, it may be very difficult if not 

20 impossible for the user to pay attention to the image 
pickup direction of the video camera. However, sincethe 
operator may be aware of the emergency, the operator 
can instruct the video camera to change the rate to the 
front priority rate or the rear priority rate so that a high 

25 quality image can be obtained in a desired direction. 
[0110] Further, when multiple users are patrolling, up- 
on operation of the emergency switch 17 by one user, 
the management station 40 may notify the other users. 
In particular, the management station 40 can specify the 

30 emergency, the user who encountered the emergency 
(video camera ID), and the location of the emergency. 
In correspondence with the specified information, the 
management station 40 may transmit an emergency in- 
struction to the video cameras of all the users near the 

35 location of the emergency or users patrolling with the 
specified user. As such, the users may be able to handle 
the emergency and since the video image may be trans- 
mitted from the user who activated the emergency 
switch to the other respective users they may have more 

40 detailed information about the emergency. 

[0111] Further, since the management station 40 can 
instruct all the video cameras to change the rate, high 
quality video images in peripheral respective areas may 
be obtained. 

45 [0112] When the emergency instruction has been re- 
ceived from another user orthe management station 40, 
the controller 51 may output an emergency incoming- 
tone or a voice instruction from the speaker 1 4. Further, 
the location of the emergency may be transmitted as 

50 GPS current-position information from the manage- 
ments station 40. Additionally, a map or the like may be 
displayed on the display unit 1 1 such that the respective 
users can accurately grasp the location of the incident. 
[0113] At the time of the user's operation of the emer- 

55 gency switch 1 7, the video camera may be operating in 
the storage mode and the obtained video data may not 
be transmitted to the management station 40. In such a 
case, the management station 40 (or other users) may 
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not be notified of the emergency. Accordingly, the con- 
troller 51 may automatically change the mode to the 
transmission mode or the multi mode upon activation of 
the emergency switch to transmit the video data to the 
management station 40. 

[0114] Further, the present video camera may include 
shock sensor 67. The shock sensor 67 may detect a 
shock applied to the video camera. The shock may oc- 
cur when the user is attacked by a thug or the user him- 
self/herself encounters an accident. As such, the user 
may not be able to depress the emergency switch 17. 
Accordingly, the controller 51 may transmit the notifica- 
tion of the emergency upon detection of the shock, in a 
manner similarto the operation of the emergency switch 
17. 

5. Rate Change by Sound Check 

[0115] Next, rate control by the controller 51 which 
can be performed by discriminating the rate change con- 
dition from processing of the sound check unit 64 and 
changing a rate status will be described with reference 
to Fig. 12. 

[0116] In this case, the sound check unit 61 may com- 
pare sound signals supplied from the front microphone 
3a and the rear microphone 3b with a threshold value 
as a predetermined sound volume level. If the volumes 
of the sound signals inputted from microphones 3a and 
3b exceed the threshold value, the sound check unit 61 
outputs a detection signal to the controller 51 . At that 
time, the sound check unit 61 may discriminate whether 
the large sound volume has occurred in the front or rear 
direction. The direction may be discriminated by taking 
the difference between the sound volumes and delay 
statuses of the respective sound signals inputted from 
the microphones 3a and 3b. Once the direction is dis- 
criminated, the sound check unit 61 may output the di- 
rection information to controller 51 . 
[0117] In Fig. 12, upon start of image pickup (record- 
ing/transmission), the controller 51 instructs the respec- 
tive encode units 53a, 53b, 54a and 54b to set the nor- 
mal rate at step F201 . That is, the controller 51 may set 
the frame rate and the compression rate for the storage 
encode unit 53a and the communication encode unit 
54a equal to the frame rate and the compression rate 
for the storage encode unit 53b and the communication 
encode unit 54b. Further, the controller 51 monitors the 
detection signal from the sound check unit 64. 
[0118] In this case, the controller 51 may detect the 
rate change conditions at steps F202, F203, F204, and 
F206. At step F202, the controller may monitor whether 
or not the user has performed the operation to change 
the rate to the front priority rate or the rate change in- 
struction to change the rate to the front priority rate has 
been received from the management station 40. At step 
F203, the controllermay monitorwhetheror notthe user 
has performed the change operation to change the rate 
to the rear priority rate or the rate change instruction to 



change the rate to the rear priority rate has been re- 
ceived from the management station 40. At step F204, 
the controller may discriminate whether or not the de- 
tection signal for a large sound volume in the front di- 

5 rection has been outputted from the sound check unit 
64. At step F206, the controller may discriminate wheth- 
er or not a large sound volume in the rear direction has 
been outputted from the sound check unit 64. If these 
rate change conditions are not detected, the controller 

10 returns to step F201 where it may continue the image 
pickup operation at the normal rate. 
[0119] At step F202, if the change operation is per- 
formed by the user or an operation or instruction from 
the management station 40 to change the rate to the 

15 front priority rate has been detected, the controller 51 
proceeds to step F208 where image pickup (recording/ 
transmission) may be performed at the front priority rate. 
That is, the controller may control the frame rate and/or 
the compression rate for the storage encode unit 53a 

20 and the communication encode unit 54a to be higher 
than the frame rate and/or lower than the compression 
rate for the storage encode unit 53b and the communi- 
cation encode unit 54b. As such, video data obtained by 
the front camera 2a may have a higher quality than video 

25 data obtained by the rear camera 2b. Further, the con- 
troller 51 continues monitoring of the detection signal 
from the sound check unit 64. 

[0120] During a period where image pickup may be 
performed at the front priority rate, the controller 51 may 

30 detect the rate change condition at steps F209, F210, 
F211, F213and F215. At step F209, the controller may 
monitor whether or not the user has performed the 
change operation to change the rate to the normal rate 
or the rate change instruction to change the rate to the 

35 normal rate has been received from the management 
station 40. At step F210, the controller may monitor 
whether or not the user has performed the change op- 
eration to change the rate to the rear priority rate or the 
rate change instruction to change the rate to the rear 

40 priority rate has been received from the management 
station 40. At step F21 1 , the controller may discriminate 
whether or not the detection signal of a large sound vol- 
ume in the rear direction has been outputted from the 
sound check unit 64. At step F213, the controller may 

45 discriminate whether or not the detection signal of a 
large sound volume in the front direction has been out- 
putted from the sound check unit 64. If the detection sig- 
nal has been outputted, the controller proceeds to step 
F214 where it may reset and restart a front sound-vol- 

50 ume timer. The front sound-volume timer may count a 
duration or a period when the large sound volume in the 
front direction is not detected using an internal timer of 
the controller 51 . At step F215, the controller may dis- 
criminate whether or not the duration where the large 

55 sound volume in the front direction is not detected is 
equivalent to a predetermined period. That is, whether 
the front sound-volume timer has timed out. During a 
period in which this detection may not be made, the con- 
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troller returns to step F208 where it continues the image 
pickup at the front priority rate. 

[0121] At step F203 in the normal rate status, or at 
step F210 in the front priority rate, if the user's change 
operation or an operation or instruction from the man- 
agement station 40 for transition to the rear priority rate 
has been detected, the controller 51 proceeds to step 
F21 7 where it may control the image pickup (recording/ 
transmission) to perform at the rear priority rate. That is, 
the controller 51 may control the frame rate and/or the 
compression rate for the storage encode unit 53b and 
the communication encode unit 54b to be higher than 
the frame rate and/or lower than the compression rate 
for the storage encode unit 53a and the communication 
encode unit 54a. As such, video data obtained by the 
rear camera 2b may have a higher quality than video 
data obtained by the front camera 2a. Further, the con- 
troller 51 continues monitoring of the detection signal 
from the sound check unit 64. 

[0122] During a period where image pickup may be 
performed at the rear priority rate, the controller 51 may 
detect the rate change condition at steps F218, F219, 
F220, F222 and F224. At step F21 8, the controller may 
monitor whether or not the user has performed the 
change operation to change the rate to the normal rate 
or the rate change instruction to change the rate to the 
normal rate has been received from the management 
station 40. At step F219, the controller may monitor 
whether or not the user has performed the change op- 
eration to change the rate to the front priority rate or the 
rate change instruction to change the rate to the front 
priority rate has been received from the management 
station 40. At step F220, the controller may discriminate 
whether or not the detection signal of a large sound vol- 
ume in the front direction has been outputted from the 
sound check unit 64. At step F222, the controller may 
discriminate whether or not the detection signal of a 
large sound volume in the front direction has been out- 
puttedfrom the sound check unit 64. If yes, the controller 
51 proceeds to step F223 where it may reset and restart 
a rear sound-volume timer. The rear sound-volume tim- 
er may count a duration or a period where the large 
sound volume in the rear direction may not be detected 
using the internal timer of the controller 51 . At step F224, 
the controller may discriminate whether or not the dura- 
tion where the large sound volume in the rear direction 
may not be detected is equivalent to a predetermined 
period. That is, whether the rear sound-volume timer 
has timed out. During the period where this detection 
may not be made, the controller 51 may return to step 
F21 7 where it may continue the image pickup operation 
at the rear priority rate. 

[0123] At any of steps F209 and F218, if the change 
operation or the change instruction from the manage- 
ment station 40 to change the rate to the normal rate 
has been detected, the controller proceeds to step F201 
where the controller 51 may change the rate to the nor- 
mal rate. That is, the controller may set the frame rate 



and the compression rate for the storage encode unit 
53a and the communication encode unit 54a, and the 
frame rate and the compression rate for the storage en- 
code unit 53b and the communication encode unit 54b 
5 at equal rates. 

[0124] At step F219, if the change operation or the 
change instruction from the management station 40 to 
change the rate to the front priority rate has been de- 
tected, the controller proceeds to step F208 where the 
controller 51 may change the rate to the front priority 
rate. At the normal rate, if a large sound volume in the 
front direction has been detected at step F204, the con- 
troller 51 may reset/start the front sound-volume timer 
at step F205 and then proceed to step F208 where it 
may change the rate to the front priority rate. Further, at 
the rear priority rate, if a large sound volume in the front 
direction has been detected at step F220, the controller 
51 may reset/start the front sound-volume timer at step 
F221 and then proceed to step F208 where it may 
change the rate to the front priority rate. In this manner, 
if the rate may be changed to the front priority rate by 
detection of large sound volume in the front direction, a 
time-out at the front sound-volume timer may be detect- 
ed at step F215. 

[0125] If the front sound-volume timer has timed out, 
the controller 51 may proceed to step F216 to perform 
the rate change. For example, if a time-out status has 
been detected at step F215 after transition to the front 
priority rate by detection of the large sound volume in 
the front direction at step F204, the controller 51 may 
return to step F201 where the rate may be changed to 
the normal rate. In a case where time-out status has 
been detected after transition to the front priority rate by 
detection of the large sound volume in the front direction 
at step F220, the controller 51 returns to step F217 
where the rate may be change to the rear priority rate. 
Further, after transition to the front priority rate by de- 
tection of the operation or instruction at steps F202 or 
F21 9, if the front sound-volume timer is started at step 
F21 4 and then the time-out status has been detected at 
step F215, the controller may return to step F208. That 
is, image pickup may continue at the front priority rate. 
[0126] At the normal rate, if the large sound volume 
in the rear direction is detected at step F206, the con- 
troller 51 may reset/start the rear sound-volume timer at 
step F207 and then proceed to step F21 7 where it may 
change the rate to the rear priority rate. Further, at the 
front priority rate, if the large sound volume in the rear 
direction is detected at step F21 1 , the controller 51 may 
reset/starttherearsound-volumetimerat step F212and 
then proceed to step F21 7 where it may change the rate 
to the rear priority rate. In this manner, if the rate is 
changed to the rear priority rate by detection of the large 
sound volume in the rear direction, a time-out status of 
the rear sound-volume timer may be detected at step 
F224. 

[0127] If the rear sound-volume timer has timed out, 
the controller 51 may proceed to step F225 where it may 
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perform the rate change. For example, if the time-out 
status has been detected at step S224 after detection 
of the large sound volume in the rear direction at step 
F206, the controller 51 may return to step F201 where 
the rate may be changed to the normal rate. If the time- 
out status has been detected at step F224 after detec- 
tion of the large sound volume in the rear direction at 
step F21 1 , the controller may return to step F208 where 
the rate may be changed to the front priority rate. Fur- 
ther, if the rear sound-volume timer may be started at 
step F223 by detection of the large sound volume in the 
rear direction at step F222 and then if thetime-out status 
has been detected at step F224, after detection of the 
operation or instruction at steps F203 or F210, the con- 
troller may return to step F21 7. That is, the controller 51 
may continue at the rear priority rate. 
[0128] As described above, thecontroller51 performs 
mode change control, with the user's operation or the 
rate change instruction from the management station 40 
as the rate change condition. Further, upon detection of 
a large sound volume in the front direction as the rate 
change condition, the operation mode may be changed 
to the front priority rate from the normal rate or the rear 
priority rate by the controller 51 . Further, upon detection 
of a large sound volume in the rear direction as the rate 
change condition, the operation mode may be changed 
to the rear priority rate from the normal rate or the front 
priority rate by the controller 51 . 
[0129] During patrol, a large sound volume may be an 
indication of an extraordinary status. For example, an 
alarm sound, an explosion, an accident, and/or a roar 
of anger, may be detected. As such, high-quality video 
data can be automatically obtained in the direction 
where the large volume sound has occurred. The ob- 
tained data may be recorded on the memory card 30 or 
transmitted to the management station 40. In particular, 
upon such extraordinary occurrence, the user may not 
have sufficient time to operate the video camera. How- 
ever, video data rate may be automatically changed in 
the direction of occurrence of the large volume sound 
upon detection of the large sound volume. Accordingly, 
high quality video images may be recorded and/or trans- 
mitted corresponding to the extraordinary occurrence. 
Further, it may be advantageous in general purposes. 
For example, when great shouts of joy arise in an event, 
a high-quality video image can be obtained in the direc- 
tion of the event. 

[0130] During image pickup at the front priority rate or 
the rear priority rate, the rate may be returned to the 
normal rate in correspondence with the user's operation 
or the rate change instruction from the management sta- 
tion 40. The rate may be returned to the normal rate if 
the user or the operator in the management station 40 
determines that recording/transmission of high-quality 
video image in the front or rear direction may not be nec- 
essary. In particular, if the large volume sound is not in- 
dicative of an extraordinary occurrence, the user or the 
operator in the management station 40 may determine 



that an extraordinary occurrence has not occurred. 
Therefore, the rate can be returned to the normal rate 
by the user's operation or an instruction from the man- 
agement station 40. 
5 [01 31 ] Further, during image pickup at the front prior- 
ity rate, if a large sound volume has not occurred in the 
front direction within a predetermined period, it may be 
not determined as an extraordinary occurrence, and, the 
rate may be returned to the initial rate status. Accord- 
ingly, it may not be necessary for the user to pay atten- 
tion to the mode status automatically changed by detec- 
tion of large sound volume. 

[0132] Similarly, during image pickup at the rear pri- 
ority rate, in a case where a large sound volume has not 
occurred in the rear direction within a predetermined pe- 
riod, the rate may be returned to the initial rate status. 
Accordingly it may not be necessary for the user to pay 
attention to the mode status automatically changed by 
detection of large sound volume. 
[0133] The predetermined time-out period may be a 
fixed value, may be arbitrarily set, or selected by the us- 
er. It may be arranged such that after transition to the 
front priority rate or the rear priority rate by detection of 
a large sound volume, processing to return the rate to 
the initial rate status in correspondence with the duration 
where a large sound volume may not be detected, may 
not be performed, or execution of the processing may 
be selectively set by the user. 

[0134] In some environments, a large sound volume 
that may not be indicative of an extraordinary occur- 
rence may be detected. Accordingly, the sound check 
unit 64 may analyze a sound signal by a frequency com- 
ponent, a level characteristic of each frequency, an at- 
tenuation pattern or the like. If the sound check unit 64 
discriminates that the sound may be a particular sound, 
it may not generate a detection signal even though the 
sound has a large volume. For example, considering air- 
port security, landing and takeoff sounds of airplanes 
may be detected as large sound volumes. However, if, 
for example, the frequency characteristics of the landing 
and takeoff sounds are previously set, it may be deter- 
mined that an input sound may be the same or similar 
to the landing and takeoff sounds by signal analysis. As 
such, the large sound volume may not indicate an ex- 
traordinary occurrence and the rate may not be changed 
to the front priority rate or the rear priority rate. 
[0135] Further, the threshold value for detection of a 
large sound volume may be a predetermined fixed val- 
ue. However, the user may arbitrarily set a threshold lev- 
el. For example, if the camera is used for security or the 
like in a noisy place, a large sound volume can be more 
accurately discriminated as an extraordinary status by 
setting the threshold value to a high level. 
[0136] In the processing shown in Fig. 12, the sound 
volume level in the front or rear direction may be detect- 
ed and the rate may be changed to the front priority rate 
or the rear priority rate. However, the rate may be 
changed to the front priority rate or the rear priority rate 
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upon detection of a predetermined target sound rather 
than a large sound volume. That is, a frequency com- 
ponent of sound, a frequency characteristic, an attenu- 
ation pattern or the like may be set as a target sound in 
the sound check unit 64. Then, analysis may be per- 
formed on the frequency components, frequency char- 
acteristics, attenuation pattern of the input sounds from 
the microphones 3a and 3b, and it may be discriminated 
whether or not they correspond with or are similar to the 
target sound. Further, at that time, it may be discriminat- 
ed whether the target sound has occurred in the front or 
rear direction, by using sound volume levels and delay 
time of the input sounds from the microphones 3a and 
3b. Then, if it is discriminated that the target sound has 
been inputted from the front side, the sound check unit 
64 may supply the detection signal to the controller 51 . 
The controller 51 may changethe rate to thefront priority 
rate as the processing may proceed from step F204 to 
step F208 (or step F220 to step F208) as shown in Fig. 
12. Further, if it is discriminated that the target sound 
has been inputted from the rear side, the sound check 
unit 64 may supply the detection signal to the controller 
51 . The controller 51 may change the rate to the rear 
priority rate as the processing may proceed from step 
F206 to step F21 7 (or step F21 1 to step F21 7) as shown 
in Fig. 12. 

[0137] For example, an alarm sound, a vehicle colli- 
sion, an explosion, and the like may be set as target 
sounds. When these sounds occur, recording/transmis- 
sion of high-quality video data in a necessary direction 
can be performed at the front priority rate or the rear 
priority rate. Further, in a case where the sound check 
unit 64 may analyze a voice print and voice prints of a 
particular person or persons, if it is determined that the 
voice print of a person picked up by the video camera 
corresponds to a particular person, a high-quality video 
image in the direction of the person may be recorded/ 
transmitted. 

[0138] As an example of setting the target sound, the 
user may set the video camera in the target sound set- 
ting mode. The target sound may be inputted from the 
microphones 3a and 3b and the sound analysis per- 
formed by the sound check unit 64 may be recorded. 
Otherwise, alarm sound patterns, a collision sound or 
the like may be preset, and the user selects one of them 
as a target sound. Further, the management station 40 
may transmit target sound data such as a particular 
alarm sound, a voice print of a wanted criminal and the 
like, and the controller 51 may receive such data and 
set it in the sound check unit 64. 

6. Rate Change by Image Analysis 

[0139] Next, the rate control performed by controller 
51 with reference to Fig. 13 will now be described. Dur- 
ing rate control, the controller 51 may discriminate the 
rate change condition from processing by the image 
analysis unit 63 and change the frame rate and the com- 



pression rate for the storage encode units 53a and 53b, 
and the communication encode units 54a and 54b, in 
correspondence with detection of the rate change con- 
dition. The image analysis unit 63 may perform image 
5 analysis on a video signal supplied from the front cam- 
era 2a and the rear camera 2b and check whether or 
not motion detection or input of target image has been 
made. 

[0140] Regarding the motion detection, it can be de- 
10 tected whether or not motion has been found by com- 
paring frames of a video signal sequentially inputted in 
a time-sequential direction. 

[0141] Further, as to the target image, data may be 
previously set as a target image in the image analysis 

15 unit 63. A target image, for example, of a particular build- 
ing, person or vehicle, a particular color or the like may 
be set. Then, processing to discriminate whether or not 
these target images are included in the input video sig- 
nal may be performed by image analysis processing. 

20 The image analysis unit 63 supplies the detection signal 
to the controller 51 in correspondence with the detection 
of a predetermined motion status or target image. Fur- 
ther, at this time, the image analysis unit 63 may supply 
information on which camera caught the predetermined 

25 motion status or target image to the controller 51 . 

[01 42] When setting a target image, the user sets the 
video camera to a target image setting mode. Then, a 
particular image may be obtained and the image anal- 
ysis unit 63 may store the image. Otherwise, data re- 

30 garding color, brightness, car model, building and the 
like may be preset as target images, and the user may 
select one of them as a target image. Further, the man- 
agement station 40 may transmit data as target images 
such as, an image of a criminal, building, car model, par- 

35 ticular color and the like, to the video camera, wherein 
the controller 51 may receive the data and set the data 
in the image analysis unit 63. 

[0143] In Fig. 13, at the start of image pickup (record- 
ing/transmission), the controller 51 may instruct the re- 

40 spective encode units 53a, 53b, 54a and 54b to set the 
normal rate, as step F301 . That is, the frame rate and 
the compression rate for the storage encode unit 53a 
and the communication encode unit 54a, and the frame 
rate and the compression rate for the storage encode 

45 unit 53b and the communication encode unit 54b, may 
be equal. 

[0144] Further, the controller 51 may monitor the de- 
tection signal from the image analysis unit 63. In this 
case, the controller 51 may detect rate change condi- 

50 tions at steps F302, F303, F304and F305. At step F302, 
the controller 51 may monitor whether or not the user 
has performed the change operation to change the rate 
to the front priority rate or the rate change instruction to 
change the rate to the front priority rate has been re- 

55 ceived from the management station 40. At step F303, 
the controller 51 may monitor whether or not the user 
has performed the change operation to change the rate 
to the rear priority rate or the rate change instruction to 
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change the rate to the rear priority rate has been re- 
ceived from the management station 40. At step F304, 
the controller 51 may discriminate whether or not the 
image analysis unit 63 has detected the image condition 
in the front direction as the rate change condition (for 
example, the motion detection or detection of target im- 
age). At step F305, the controller 51 may discriminate 
whether or not the image analysis unit 63 has detected 
the image condition in the rear direction as the rate 
change condition (for example, the motion detection or 
detection of target image). If these rate change condi- 
tions are not detected, the controller returns to step 
F301 where it may continue the image pickup operation 
at the normal rate. 

[0145] At step F302, if an operation or instruction to 
change the rate to the front priority rate is detected, the 
controller51 proceeds to step F306 and performs image 
pickup (recording/transmission) at the front priority rate. 
That is, the frame rate and/or the compression rate for 
the storage encode unit 53a and the communication en- 
code unit 54a may be higher than the frame rate and/or 
lower than the compression rate for the storage encode 
unit 53b and the communication encode unit 54b. As 
such, video data obtained by the front camera 2a may 
have a higher quality than video data obtained by the 
rear camera 2b. Further, the controller 51 may continue 
monitoring of the detection signal from the image anal- 
ysis unit 63. 

[0146] During a period where image pickup may be 
performed at the front priority rate, the controller 51 may 
detect the rate change condition at steps F307, F308, 
F309 and F310. At step F307, the controller 51 may 
monitor whether or not the user has performed the 
change operation to change the rate to the normal rate 
or the rate change instruction to change the rate to the 
normal rate has been received from the management 
station 40. At step F308, the controller 51 may monitor 
whether or not the user has performed the change op- 
eration to change the rate to the rear priority rate or the 
rate change instruction to change the rate to the rear 
priority rate has been received from the management 
station 40. At step F309, the controller 51 may discrim- 
inate whether or not the image analysis unit 63 has de- 
tected the motion detection or detection of a target im- 
age in the rear direction. At step F31 0, the controller 51 
may discriminate whether or not the image condition for 
placing priority in the front direction has been cancelled. 
The determination of cancellation of image condition will 
be described later. If these rate change conditions are 
not detected, the controller 51 may return to step F306 
where it may continue the image pickup operation at the 
front priority rate. 

[0147] In the normal rate status as shown in F303, or 
in the front priority rate as shown in F308, if the controller 
detects an operation or instruction to change to the rear 
priority rate, the controller 51 may proceed to step F311 , 
at which it performs image pickup (recording/transmis- 
sion) at the rear priority rate. That is, the frame rate and/ 



or the compression rate for the storage encode unit 53b 
and the communication encode unit 54b may be higher 
than the frame rate and/or lower than the compression 
rate for the storage encode unit 53a and the communi- 
5 cation encode unit 54a. As such, video data obtained by 
the rear camera 2b, may have a higher quality than the 
video data obtained by image pickup by thefront camera 
2a. Further, the controller 51 may continue monitoring 
for the detection signal from the image analysis unit 63. 
[0148] During a period where image pickup may be 
performed at the rear priority rate, the controller 51 may 
detect the rate change condition at steps F312, F313, 
F314 and F315. At step F312, the controller 51 may 
monitor whether or not the user has performed the 
change operation to change the rate to the normal rate 
or the rate change instruction to change the rate to the 
normal rate has been received from the management 
station 40. At step F313, the controller 51 may monitor 
whether or not the user has performed the change op- 
eration to change the rate to thefront priority rate or the 
rate change instruction to change the rate to the front 
priority rate has been received from the management 
station 40. At step F31 4, the controller 51 may discrim- 
inate whether or not the image analysis unit 63 has de- 
tected the image condition in thefront direction, i.e., mo- 
tion detection or target image detection has been made 
in a video signal obtained by image pickup from the front 
camera 2a. At step F31 5, the controller 51 may discrim- 
inate whether or notthe image condition to place priority 
in the rear direction has been canceled. If these rate 
control conditions are not detected, the controller 51 
may return to step F31 1 where it may it continue the im- 
age pickup operation at the rear priority rate. 
[0149] If the change operation to change the rate to 
the normal rate or the change instruction from the man- 
agement station 40 has been detected at any of steps 
F307 and F312, the controller proceeds to step F301 
where the controller 51 may change the rate to the nor- 
mal rate. At step F313, if the change operation or the 
change instruction from the management station 40 to 
change the rate to the front priority rate has been de- 
tected, the controller proceeds to step F306 where the 
controller 51 may change the rate to the front priority 
rate. At the normal rate, as shown in step F304, or at 
the rear priority rate, as shown in step F31 4, if the image 
condition in the front direction has been detected, the 
controller 51 may proceed to step F306 and change the 
rate to the front priority rate. At the normal rate, as shown 
in step F305, or at the front priority rate, as shown in 
step F309, if the image condition in the rear direction 
has been detected, the controller 51 may proceed to 
step F311 and change the rate to the rear priority rate. 
At the front priority rate, as shown in step F310, if can- 
cellation of the image condition with front priority has 
been detected, or, at the rear priority rate, as shown in 
step F315, if cancellation of the image condition with 
rear priority has been detected, the controller 51 may 
return to step F301 and change the rate to the normal 
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rate. 

[0150] According to the processing steps shown in 
Fig. 13, when a scene from which a high-quality video 
image should be obtained comes within an image pick- 
up range (front or rear), the rate may be automatically 
changed such that the video image in the desired direc- 
tion has a high image quality. For example, if a dynamic 
motion due to an attack by a thug or the like is detected, 
the scene in the direction in which the image of the thug 
or the like may be obtained by image pickup can be re- 
corded and transmitted with high image quality. In this 
case, since the user may not have sufficient time for op- 
eration, the rate change to front/rear priority rate may 
be performed automatically. 

[0151] For example, in response to surroundings of a 
heavily guarded building, a person (such as a wanted 
criminal), or the clothing or color thereof of a runaway 
criminal or the like, video data in the direction in which 
the image of the person are obtained may have high im- 
age quality. Accordingly, the control may be useful in se- 
curity and inspection. Further, for general purposes, 
when a high-quality image is desired in a particular area, 
if a photograph of the place (building) or the like may be 
set as a target image, a desired image with high quality 
can be obtained by image pickup without the user's at- 
tention to the operation. 

[0152] During image pickup at the front priority rate or 
the rear priority rate, the rate may be returned to the 
normal rate if the user or the operator in the manage- 
ment station 40 determines that high quality image pick- 
up may not be necessary in the front or rear direction. 
Further, if it is determined that the image condition for 
front priority has been cancelled or if the image condition 
for rear priority has been cancelled, the rate may auto- 
matically return to the normal rate. Thereby, it may not 
be necessary for the user to pay attention to the rate 
status and the change operation. 
[0153] The cancellation of an image condition may be 
determined by time counting. For example, in a case 
where the rate may be changed to the front priority rate 
by detection of an image condition in the front direction, 
if neither motion nor a target image is detected in the 
front direction within a continuous predetermined peri- 
od, it can be determined that the image condition has 
been cancelled. In this case, the rate may not be simply 
returned to the normal rate but returned to the previous 
rate before the rate change occurred. The cancellation 
of an image condition for the rear priority rate can be 
determined in a similar manner. 

[0154] Additionally, if a motion or target image has 
been detected in front and rear directions it may be de- 
termined that the image condition has been cancelled. 
That is, the determination may be that the image pickup 
should be performed in the front and rear directions with 
equal image quality. 



7. Rate Change by Position Detection 

[01 55] Next, an example where the controller 51 may 
determine the rate change condition based on the cur- 
5 rent position information from the GPS decoder 65 and 
perform rate change will be described with reference to 
Fig. 14. 

[01 56] In Fig. 1 4, at the start of image pickup (record- 
ing/transmission), the controller 51 may instruct the re- 
spective encode units 53a, 53b, 54a and 54b to set the 
normal mode at step F401 . In this case, information des- 
ignating an area such as latitudinal range and longitudi- 
nal range information may be previously set as a crite- 
rion of determination. The controller 51 may compare 
the latitude and longitude of the current position infor- 
mation from the GPS decoder 65 with the above infor- 
mation of the designated area, and determine whether 
or not the current position may be within the designated 
area at step F402. During a period in which the current 
position may not be within the designated area, the con- 
troller 51 may continue the image pickup control at the 
normal rate. 

[01 57] Regarding the designated area information, for 
example, the user previously inputs a designated area 
by operating the video camera. Various input forms may 
be used, such as, a map may be displayed on the dis- 
play unit 11 and the user can designate a range in the 
map. Alternatively, the user may input or select a place, 
thereby setting the latitude and longitude ranges in cor- 
respondence with the inputted or selected place as the 
designated area information. Further, the management 
station 40 may transmit data regarding the latitude and 
longitude ranges for the designated area to the video 
camera, wherein the controller 51 may receive it as the 
information on the designated area. 
[0158] In the controller 51 , a particular place, building, 
or the like may be set as a subject to be focused on dur- 
ing image pickup in the designated area. The designat- 
ed area may be designated as an area name by the user 
orthe management station 40. Further, a particularpoint 
(building or place) in the designated area may be set as 
a subject to be focused on during image pickup. Other- 
wise, the name of a particular building, street address 
orthe like may be inputted. As such, it may be the sub- 
ject to be focused on during image pickup while a pe- 
ripheral area of the subject may be automatically set as 
a designated area. 

[0159] At step F402, if the current position is deter- 
mined to be within the designated area, the processing 
by the controller 51 may proceed from step F402 to 
F403, at which time, direction information from a direc- 
tion detection unit 7 in the camera unit 1 may be 
checked. Then at step F404, it may be determined 
whether image pickup should be concentrated in the 
front direction or the rear direction. That is, it may be 
determined whether the camera directed to the direction 
of the subject to be focused on should be the front cam- 
era 2a or the rear camera 2b. If the camera is the front 
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camera 2a, the process proceeds to step F405 wherein 
control may be performed such that image pickup (re- 
cording/transmission) may be performed at the front pri- 
ority rate. That is, the frame rate and/or the compression 
rate for the storage encode unit 53a and the communi- 
cation encode unit 54a may be higher than the frame 
rate and/or lower than the compression rate for the stor- 
age encode unit 53b and the communication encode 
unit 54b. As such, video data obtained by image pickup 
by the front camera 2a (which may be video data ob- 
tained in the direction of the subject to be focused on) 
has a higher quality than video data obtained by the rear 
camera 2b. 

[0160] During a period in which the image pickup may 
be performed at the front priority rate, the controller 51 
may compare the current position information with the 
information aboutthe designated area. At step F406, the 
controller51 may discriminate whether or notthe current 
position is outside the designated area. If it is deter- 
mined at step F406 that the current position is outside 
the designated area, the process proceeds to step 
F401, at which time, processing in the respective en- 
code units 53a, 53b, 54a and 54b may be set at the nor- 
mal rate. Further, if it is determined at step F406 that the 
current position is not outside the designated area, the 
direction information from the direction detection unit 7 
may be checked at step F407. Then at step F408, it may 
be determined whether or not the camera directed to the 
direction of the subject is still the front camera 2a. If the 
camera is still the front camera 2a, the process returns 
to step F405, at which the status of front priority rate 
may be continued. 

[0161] At step 404, if it is determined that the camera 
directed to the direction of the subject to be focused on 
during image pickup is the rear camera 2b, the process 
proceeds to step F409. At step F409, control may be 
performed such that image pickup (recording/transmis- 
sion) may be performed at the rear priority rate. As such , 
video data obtained by the rear camera 2b (that is, video 
data obtained by image pickup in the direction of the 
subjectto be focused on during image pickup) may have 
a higher quality than video data obtained by the front 
camera 2a. 

[0162] During a period in which the image pickup may 
be performed at the rear priority rate, the controller 51 
may compare the current position information with the 
information for the designated area. At step F410, the 
controller discriminates whether or not the current posi- 
tion is outside the designated area. If it is determined at 
step F41 0 that the current position is outside the desig- 
nated area, the process proceeds to step F401 , at which 
time, processing in the respective encode units 53a, 
53b, 54a and 54b may be set at the normal rate. Further, 
if it is determined at step F41 0 that the current position 
is within the designated area, the direction information 
from the direction detection unit 7 may be checked at 
step F411. Then at step F412, it may be determined 
whether or not the camera directed to the direction of 



the subject is still the rear camera 2b. If the camera is 
still the rear camera 2b, the process returns to step F409 
at which the rear priority rate may be continued. 
[0163] At the front priority rate, if it is determined at 
5 step F408 that the camera directed to the direction of 
the subject to be focused on during image pickup has 
become the rear camera 2b, the process proceeds to 
step F409. At step F409 the rate may be changed to the 
rear priority rate. Further, if it is determined at step F41 2 
10 that the camera directed to the direction of the subject 
to be focused in image pickup has become the front 
camera 2a, the process proceeds to step F405 where 
the rate may be changed to the front priority rate. 
[0164] According to the processing shown in Fig. 14, 
15 recording/transmission of high-quality video data may 
be performed automatically for a video image directed 
to the direction of the subject to be focused on during 
image pickup. Accordingly, such processing may be de- 
sired where a heavily-guarded place is being patrolled 
20 or in other dangerous areas. Further, a particular place 
within the area may be monitored and/or the states re- 
corded. 

[0165] In the designated area, high-quality image 
pickup can always be performed for a subject to be fo- 
25 cused on during image pickup by selecting in between 
the front priority rate and the rear priority rate in corre- 
spondence with direction discrimination. For general 
purposes, when a high-quality image pickup should be 
performed in a particular place in, for example, walking 
30 or hiking, if the location may be set as the subject to be 
focused on during image pickup, a desired image may 
be obtained without user's attention to the operation of 
the video camera. 

[0166] Further, since the rate may be changed to the 
35 front priority rate or the rear priority rate in the designat- 
ed area then the rate may return automatically to the 
normal rate in a position out of the designated area. It 
may be unnecessary for the user to be conscious of or 
pay attention to the rate operation, which may be pref- 
40 erable in security duty or the like. 

8. Modification 

[0167] Respective examples and or features have 
45 been described above as control processing for chang- 
ing the frame rate and/or the compression rate. Howev- 
er, the present video camera is not so limited. In addi- 
tion, various changes and/or other features may be em- 
ployed. 

50 [0168] In the processes previously described, image 
pickup may be started at the normal rate. However, im- 
age pickup may be initially performed at the front priority 
rate or the rear priority rate. Additionally, the rate change 
may be performed in accordance with a predetermined 

55 rate change condition. 

[0169] Further, as previously described, the rate may 
be selected from three statuses: the normal rate, the 
front priority rate and the rear priority rate. However, the 
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normal rate may be omitted and selection may be made 
between the front priority rate and the rear priority rate. 
In such case, initially an image pickup operation may be 
started at the front priority rate, and the rate may be 
changed to the rear priority rate in correspondence with 
a predetermined rate change condition. On the other 
hand, initially the image pickup operation may be started 
at the rear priority rate, and the rate may be changed to 
the front priority rate in correspondence with a predeter- 
mined rate change condition. 

[0170] Further, at the front priority rate, for example, 
if the frame rate or the compression rate may be 
changed in a step-like manner, the quality of video data 
in the front direction can be improved in a step-like man- 
ner. That is, in the front priority rate, the rate change may 
be performed in plural steps. In this case, the rate to be 
controlled may be determined based on the status of a 
detection of plural rate change conditions or the number 
of detections, or the rate may be determined based on 
the detected rate change condition(s). 
[0171] An example of rate change will be given under 
the assumption that a selection may be made between 
a first rate and second rate as the rate for a front video 
image within the front priority rate, and the second rate 
may be a rate at which an obtained image has quality 
higher than that at the first rate. At the normal rate or 
the rear priority rate, if one of the rate change conditions 
for the front priority rate is detected, the rate may be 
changed to the first rate of the front priority rate. Further, 
if one of the rate change conditions for the front priority 
rate is detected, the rate may be changed to the second 
rate. At the normal rate or the rear priority rate, if one of 
the rate change conditions for the front priority rate is 
detected, the rate may be changed to the first rate of the 
front priority rate. Further, at the normal rate or the rear 
priority rate, if the plural rate change conditions for the 
front priority rate are detected, the rate may be changed 
to the second rate of the front priority rate. 
[0172] With regard to the rate change conditions for 
the front priority rate, when in the case of the user's op- 
eration and/or when a subject to be focused in image 
pickup is within a designated area and the like, the rate 
may be changed to the first rate of the front priority rate. 
In the case of detection of a large sound volume, detec- 
tion of target sound, detection of image motion, detec- 
tion of image target and the like, the rate may be 
changed to the second rate of the front priority rate. In 
this manner, the rate may be determined in correspond- 
ence with the type of detected rate change condition. 
[0173] The present video camera is not limited to the 
processes described above. Rather, various other proc- 
esses than the above examples can be performed. In 
the case of the rear priority rate, the rate change in plural 
steps like the above first rate and the second rate, can 
be performed in a similar manner. Further, as the rate 
change condition, the combination of the rate change 
conditions shown in the above respective examples can 
be employed. That is, the rate change conditions, the 



user's operation, the instruction from the management 
station 40, the detection of large sound volume, the de- 
tection of sound target, the detection of image motion, 
the detection of image target, and the direction of a sub- 
5 ject to be focused in image pickup in a designated area 
and the like may be used. However, all or a part of these 
conditions may also be utilized. 

[0174] Further, front and rear temperature sensors, 
an acceleration sensor and the like may be provided. 

10 The temperature statuses, acceleration status and the 
like may be detected as the rate change conditions for 
the front priority rate or the rear priority rate. 
[0175] Upon detection of a shock by the shock sensor 
67, the direction from which the shock has been applied 

15 may be detected. According to the detected direction the 
rate may be changed to the front priority rate or the rear 
priority rate. 

[0176] Further, the respective rate change conditions 
may be weighted. For example, if a condition for the rear 

20 priority rate and a condition for the front priority rate 
overlapped with each other are detected, the front pri- 
ority rate or the rear priority rate may be selected in ac- 
cordance with which one may be a more important rate 
change condition. 

25 [0177] Further, front and rear directions have been 
described where image pickup may be performed in the 
two directions. However, image pickup may be per- 
formed in more directions such as three directions or 
four directions. In such a case, control may be per- 

30 formed such that the compression rate and the frame 
rate in the respective corresponding encode units are 
changed in correspondence with the rate change con- 
ditions, that is, high-quality video data can be obtained 
in the direction in which image pickup may be performed 

35 to obtain the image of an important scene. 

[0178] Further, in the above examples, the storage 
mode, the transmission mode and the multi mode are 
the operation modes. However, the operation mode may 
be automatically changed in correspondence with the 

40 detection of the rate change condition or another condi- 
tion. For example, the multi mode or the transmission 
mode may be automatically set within a designated area 
such that video data may be transmitted to the manage- 
ment station 40 without fail. Further, when the memory 

45 capacity becomes small, the storage mode may be 
changed to the transmission mode or the multi mode. In 
addition, in the multi mode, when the battery capacity 
becomes equal to or less than a predetermined value, 
the mode may be changed to the transmission mode or 

50 the storage mode. 

[01 79] In the present video camera, frame processing 
to change the frame rate has been described as frame 
extraction processing. That is, the quality of the video 
image in the front direction may be different from that in 

55 the rear direction by the number of frames extracted 
from frame strings of video signals obtained from the 
CCD units 5a and 5b. However, the operations of the 
CCD units 5a and 5b themselves may be changed such 



21 



41 



EP 1 345 420 A2 



42 



that they have frame rates different from each other. For 
example, a CCD transfer clock to be supplied to the 
CCD unit 5a and a CCD transfer clock to be supplied to 
the CCD unit 5b can be variably controlled to different 
frequencies. In this frame processing, the frame rates 
for the front video data and the rear video data are var- 
iable 

[0180] Further, as processing subsequent to encod- 
ing for recording or encoding for communication, the 
frame rate may be set by performing frame thinning/ 
frame interpolation, or the compression rate may beset 
by performing pixel thinning/pixel interpolation. Accord- 
ingly, the frame processing and the compression 
processing are not necessarily performed by the stor- 
age encode units 53a and 53b and the communication 
encode units 54a and 54b. Therefore, various apparatus 
constructions can be employed. 
[0181] Further, the frame processing and the com- 
pression processing, for example, may be performed in 
plural steps. For example, two-step compression 
processing may be performed which includes first-step 
compression and second-step compression which is dif- 
ferent from one-step compression. 
[0182] As another example, at the front priority rate, 
only the first-step compression processing may be per- 
formed on a video signal obtained from the front camera 
2a and the first-step compression processing and the 
second-step compression processing may be per- 
formed on a video signal obtained from the rear camera 
2b. In this case, the rate (i.e., video quality) in the front 
video data may be different from that in the rear video 
data. Further, three or more steps may be used for com- 
pression processing. The compression processing in 
each step may be performed based on the same com- 
pression method or different compression methods. 
Similar processing may be performed regarding the 
frame rate. 

[0183] As understood from the above description, ac- 
cording to an embodiment of the present invention, one 
or both of the compression rates in the compression 
processing and the frame rates in the frame processing 
in a video signal obtained in a first direction may be dif- 
ferent from one or both of the compression rates in the 
compression processing and the frame rates in the 
frame processing in a video signal obtained in a second 
direction. That is, the quality of video data obtained by 
image pickup in the first direction can be different from 
that obtained by image pickup in the second direction. 
[0184] Accordingly, appropriate recording/transmis- 
sion of video data corresponding with the direction of a 
scene from which high-quality video data may be ob- 
tained may be realized. In particular, arranging the rate 
change conditions to be all or a part of the user's rate 
change operation, reception of a signal of the rate 
change instruction, a sound volume status equal to or 
greater than a predetermined value from one direction, 
a particular target sound from one direction, a predeter- 
mined motion status of image in one direction, a partic- 



ular target image in one direction, and determination 
that the current position may be within a predetermined 
area (and direction), may perm it a high-quality video im- 
age for a scene in an appropriate direction correspond- 

5 ing to the circumstance. 

[0185] Further, this enables operation even in a situ- 
ation where the user cannot perform the operation with- 
out difficulty. In other words, a video image in an appro- 
priate direction corresponding to time and circumstance 

10 can be obtained with high quality without imposing a bur- 
den of image pickup operation on the user. This is very 
preferable in image pickup while other work may be per- 
formed, or for the purpose of cellular image pickup dur- 
ing patrol by a police officer or a security guard. 

15 [01 86] Further, for improved security or safety for the 
security guard, image pickup may be performed around 
the surroundings in a wide range such as front and rear 
directions, and high-quality image pickup may be per- 
formed in the direction of important scene. 

20 [0187] Further, the rate change instruction may be 
sent from the image pickup management apparatus 
(management station) to the image pickup apparatus. 
This may help in taking command for security, grasping 
the situation and taking countermeasures to an emer- 

25 gency status. Further, as the rate change conditions 
such as the target image and the target sound can be 
set in the image pickup apparatus from the side of the 
image pickup management apparatus, image pickup 
can be preferably performed in correspondence with se- 

30 curity and inspection purposes. 

[01 88] If the video signals in the first direction and the 
second direction subjected to the compression process- 
ing and/or the frame processing are recorded on a re- 
cording medium, a video image during patrol (for exam- 

35 pie a video image in the direction of scene which be- 
came important) can be stored with high image quality 
and can be utilized as inspection information, evidence 
and the like. 

[0189] Further, as the video signals in the first direc- 

40 tion and the second direction subjected to the compres- 
sion processing and/or the frame processing are trans- 
mitted, a patrol video image can be monitored in the im- 
age pickup management apparatus (management sta- 
tion), or can be stored on a recording medium. Further, 

45 a video image in the direction of a scene which may be 
important can be monitored or stored with high image 
quality. This enables the management station to grasp 
the guarded situation, status of security, the place of in- 
cident andthe likeandtake command, or improve safety 

50 for the user. 

[01 90] As the rate in the compression processing and/ 
or the frame processing can be changed by the user's 
operation, high-quality image pickup can be performed 
in a direction corresponding to the user's convenience. 

55 Further, the rate can be changed by the signal of rate 
change instruction received by the communication 
means. High-quality image pickup can be performed in 
a desired direction in correspondence with the conven- 
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ience of the image pickup management apparatus 
(management station) or other users (other security 
guards or the like). In particular, upon occurrence of a 
crime, the image pickup management apparatus may 
issue instructions to the image pickup apparatuses of 5 
respective security guards, police officers around the 
place of the crime, to reduce the compression rate and/ 
or increase the frame rate in the frame processing for a 
video image in a necessary direction, so as to enable 
high-quality image pickup to be performed. This may be 10 
very effective for checking the situation and solution of 
the crime. 

[0191] Further, the rate change may be performed in 
correspondence with detection of sound volume status 
equal to or greaterthan a predetermined valuefrom one 15 
direction, a particular target sound from one direction, a 
predetermined motion status of an image in one direc- 
tion, and a particular target image in one direction, and 
high-quality image pickup may be performed about a 
necessary direction. This may be appropriate as 20 
processing for an emergency. 

[0192] Further, in a case where the current position 
may be within a predetermined area, as high-quality im- 
age pickup may be performed about a direction which 
may be a predetermined direction. The processing may 25 
be preferable especially for the purpose of high-quality 
image pickup mainly in a particular place such as a dan- 
gerous area and/or heavily-guarded area. 
[0193] Further, the effects of use in security and police 
purposes have been described, however, it may be ap- 30 
propriate in general purposes to perform the rate 
change in correspondence with detection of sound vol- 
ume status equal to or greaterthan a predetermined val- 
uefrom one direction, a particulartarget sound from one 
direction, a predetermined motion status of image in one 35 
direction, and a particulartarget image in one direction 
and designated area (and direction) and perform high- 
quality image pickup about a necessary direction. For 
example, when great shouts of joy arise, for example, 
in an event, a high-quality image pickup may be per- 40 
formed in the direction in which the great shouts of joy 
arose. The image of an important scene can be obtained 
with a high quality. Alternatively, in a designated area 
and direction, high-quality image pickup can be per- 
formed in a particular area. Thus, many opportunities 45 
may be available for use of embodiments of the present 
invention. 

[0194] Although illustrative embodiments of the 
present invention and modifications thereof have been 
described in detail herein, it is to be understood that this 50 
invention is not limited to these embodiments and mod- 
ifications, and that other modifications and variations 
may be effected by one skilled in the art without depart- 
ing from the spirit and scope of the invention. 
[0195] In so far as the embodiments of the invention 55 
described above are implemented, at least in part, using 
software-controlled data processing apparatus, it will be 
appreciated that a computer program providing such 



software control and a storage medium by which such 
a computer program is stored are envisaged as aspects 
of the present invention. 



Claims 

1. An image pickup apparatus comprising: 

video signal generating means for generating 
video signals in a first direction and a second 
direction; 

signal processing means for changing a frame 
rate of said video signals in the first and the sec- 
ond direction; 

detection means for detecting that a state of the 
apparatus matches a predetermined condition 
for changing said frame rate of said video sig- 
nal; and 

controlling means for controlling said signal 
processing means so as to change the frame 
rate of said video signals in the first and/or the 
second direction on the basis of said predeter- 
mined condition corresponding to the state of 
the apparatus detected by said detection 
means. 

2. A signal processing apparatus for processing a vid- 
eo signal, said apparatus comprising: 

generating means, having bi-directional image 
pickup devices, for shooting scenes in a first di- 
rection and a second direction and for generat- 
ing a first video signal and a second video sig- 
nal respectively corresponding to the scenes of 
the first and second directions; 
compression means, connected to said gener- 
ating means, for receiving said first and second 
video signals and for performing a compression 
process on said first and second source video 
signals with variable compression rates to gen- 
erate afirst compressed video signal and a sec- 
ond compressed video signal; 
transmitting means for transmitting said first 
and second compressed video signals with var- 
iable transmission rates; 
detecting means for detecting an event in a 
shooting position to generate a detection signal 
indicating at least a direction in which said 
event occurred; and 

controlling means for controlling said variable 
compression rates and said variable transmis- 
sion rates in response to said detection signal 
such thatthe video signal correspondingto said 
detection has priority. 

3. A wearable signal processing apparatus compris- 
ing: 
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an image pickup device for generating a source 
video signal; 

a signal processing device, connected to said 
image pickup device, for receiving said source 
video signal and for performing image com- 5 
pression on said source video signal to gener- 
ate compressed video signal with variable com- 
pression rates; 

a recording device for recording said com- 
pressed video signal on a recording media with 10 
variable frame rates; and 
a mounting device for mounting said image 
pickup device, signal processing device and re- 
cording device on a cloth of the operator, 
whereby said devices are worn by the mounting 15 
device. 



4. An image pickup apparatus comprising: 

video signal generating means for generating 20 
video signals for a plurality of directions; 
signal processing means for changing at least 
one of a frame rate and a compression rate of 
said video signals; 

detection means for detecting a predetermined 25 
condition; and 

controlling means for controlling said signal 
processing means so as to change the appro- 
priate one or ones of the frame rate and com- 
pression rate of said video signals in at least 30 
one of said directions on the basis of the de- 
tected predetermined condition, 

whereby said image pickup apparatus is in- 
tended to be mounted on an article of clothing worn 35 
by an operator. 

5. The image pickup apparatus according to claim 4, 
further comprising a recording means for recording 

the first video signal and the second video signal on 40 
a recording medium. 

6. The image pickup apparatus according to claim 4, 
further comprising communicating means for trans- 
mitting the first video signal and the second video 45 
signal. 

7. The image pickup apparatus according to claim 4, 
further comprising an operating means for perform- 
ing a rate switching operation, and wherein said 50 
predetermined condition is said rate switching op- 
eration. 

8. The image pickup apparatus according to claim 4, 
further comprising communication means for re- 55 
ceiving a rate switching instruction signal, and 
wherein said predetermined condition is said rate 
switching instruction. 



9. The image pickup apparatus according to claim 4, 
further comprising: 

sound pickup means capable of collecting 
sound and generating a sound signal; and 
sound checking means for comparing said 
sound signal to a predetermined level, 

wherein if said sound signal is equal to or ex- 
ceeds said predetermined level, said sound signal 
is said predetermined condition. 

10. The image pickup apparatus according to claim 9, 
further comprising direction detecting means for de- 
termining a direction from which the sound signal 
originated from. 

11. The image pickup apparatus according to claim 4 
further comprising: 

sound pickup means capable of collecting 
sound in a first direction and a second direction 
and generating afirst sound signal correspond- 
ing to said first direction and a second sound 
signal corresponding to said second direction; 
and 

sound checking means for comparing said first 
sound signal and said second sound signal to 
a predetermined level, 

wherein if said first sound signal or said sec- 
ond sound signal is equal to or exceeds said pre- 
determined level, the respective sound signal is 
said predetermined condition. 

12. The image pickup apparatus according to claim 11 , 
further comprising direction detecting means for de- 
termining a direction from which the first sound sig- 
nal and the second sound signal originated from. 

13. The image pickup apparatus according to claim 4 
further comprising: 

sound pickup means capable of collecting 
sound and generating a sound signal; and 
sound checking means for comparing said 
sound signal to a target sound, 

wherein if said sound signal is similar to said 
target sound, said sound signal is said predeter- 
mined condition. 

14. The image pickup apparatus according to claim 13 
further comprising direction detecting means for de- 
termining a direction from which the sound signal 
originated from. 

15. The image pickup apparatus according to claim 4 
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further comprising: 

sound pickup means capable of collecting 
sound in a first direction and a second direction 
and generating a first sound signal correspond- 
ing to said first direction and a second sound 
signal corresponding to said second direction; 
and 

sound checking means for comparing said first 
sound signal and said second sound signal to 
a target sound, 



16. 



17. 



said second direction for detecting a target image, 
and wherein said detected target image is said pre- 
determined condition. 

18. The image pickup apparatus according to claim 4, 
further comprising image analyzing means for ana- 
lyzing the video signals in said first direction and 
said second direction for detecting a predetermined 
motion, and wherein said detected predetermined 
motion is said predetermined condition. 

19. The image pickup apparatus according to claim 4, 
further comprising current position detecting means 
for determining a position of said image pickup ap- 
paratus. 

20. The image pickup apparatus according to claim 4, 
further comprising emergency switching means for 
alerting a management station of an emergency. 



22. An image pickup method, comprising the steps of: 

generating video signals in a first direction and 
a second direction; 

changing at least one of a frame rate and a 
compression rate of said video signals in the 
first and the second direction; 



detecting a predetermined condition; and 
controlling said changing step so as to change 
the appropriate one or ones of the frame rate 
and compression rate of said video signals in 
5 the first and/or the second direction on the ba- 

sis of the detected predetermined condition. 

23. The method according to claim 22, further compris- 
ing the step of recording the first video signal and 

10 the second video signal on a recording medium. 

24. The method according to claim 22, further compris- 
ing the step of transmitting the first video signal and 
the second video signal. 

25. The method according to claim 22, further compris- 
ing the step of performing a rate switching opera- 
tion, and wherein said predetermined condition is 
said rate switching operation. 

26. The method according to claim 22, further compris- 
ing the step of receiving a rate switching instruction 
signal, and wherein said predetermined condition is 
said rate switching instruction. 

27. The method according to claim 22, further compris- 
ing the steps of: 

collecting sound; 
30 generating a sound signal; and 

comparing said sound signal to a predeter- 
mined level, 

wherein if said sound signal is equal to or ex- 
35 ceeds said predetermined level, said sound signal 
is said predetermined condition. 

28. The method according to claim 27, further compris- 
ing the step of determining a direction from which 

40 the sound signal originated from. 

29. The method according to claim 22, further compris- 
ing the steps of: 

collecting sound in a first direction and a sec- 
ond direction; 

generating a first sound signal corresponding 
to said first direction and a second sound signal 
corresponding to said second direction; and 
comparing said first sound signal and said sec- 
ond sound signal to a predetermined level, 

wherein if said first sound signal or said sec- 
ond sound signal is equal to or exceeds said pre- 
ss determined level, the respective sound signal is 
said predetermined condition. 

30. The method according to claim 29, further compris- 



wherein if one of said first sound signal and 
said second sound signal is similar to said target 
sound, the respective sound signal is said predeter- 15 
mined condition. 

The image pickup apparatus according to claim 1 5, 
further comprising direction detecting means for de- 
termining a direction from which the first sound sig- 20 
nal and the second sound signal originated from. 

The image pickup apparatus according to claim 4, 
further comprising image analyzing means for ana- 
lyzing the video signals in said first direction and 25 



21 . The image pickup apparatus according to claim 20, 
wherein upon activation of said emergency switch- 
ing means, said video signals and said location of 
said image pickup apparatus are transmitted to said 
management station. 
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ing the step of alerting a management station of an 
emergency. 

39. The method according to claim 38, wherein upon 
5 activation of said emergency switching means, said 

video signals and said location of said image pickup 
apparatus are transmitted to said management sta- 
tion. 

10 40. A signal processing method for processing a video 
signal, said method comprising the steps of: 



ing the step of determining a direction from which 
the first sound signal and the second sound signal 
originated from. 

31 . The method according to claim 22, further compris- 
ing the steps of: 

collecting sound; 
generating a sound signal; and 
comparing said sound signal to a target sound, 

wherein if said sound signal is similar to said 
target sound, said sound signal is said predeter- 
mined condition. 

32. The method according to claim 31 , further compris- 
ing the step of determining a direction from which 
the sound signal originated from. 

33. The method according to claim 22, further compris- 20 
ing the steps of: 

collecting sound in a first direction and a sec- 
ond direction; 

generating a first sound signal corresponding 
to said first direction and a second sound signal 
corresponding to said second direction; and 
comparing said first sound signal and said sec- 
ond sound signal to a target sound, 

wherein if one of said first sound signal and 
said second sound signal is similar to said target 
sound, the respective sound signal is said predeter- 
mined condition. 

34. The method according to claim 33, further compris- 
ing the step of determining a direction from which 
the first sound signal and the second sound signal 
originated from. 

35. The method according to claim 22, further compris- 
ing the step of analyzing the video signals in said 
first direction and said second direction for detect- 
ing a target image, and wherein said detected target 
image is said predetermined condition. 

36. The method according to claim 22, further compris- 
ing the step of analyzing the video signals in said 
first direction and said second direction for detect- 
ing a predetermined motion, and wherein said de- 50 
tected predetermined motion is said predetermined 
condition. 

37. The method according to claim 22, further compris- 
ing the step of determining a position of said image 55 
pickup apparatus. 

38. The method according to claim 22, further compris- 



capturing scenes in a first direction and a sec- 
ond direction and generating a first video signal 
and a second video signal respectively corre- 
sponding to the scenes of the first and second 
directions using a bi-directional image pickup 
device; 

detecting an event and generating a detection 
signal in response thereto; 
processing said first and second video signals 
so as to perform at least one of a compression 
operation in which said first and second video 
signals are processed with variable compres- 



25 sion rates and a frame rate operation in which 

said first and second video signals are proc- 
essed with variable frame rates so as to form 
first and second processed video signals; 
transmitting said first and second processed 
30 video signals; and 

controlling the appropriate one or ones of said 
variable compression rates and said variable 
frame rates in response to said detection sig- 
nal, 



35 



40 



wherein the bi-directional image pickup de- 
vice is intended to be mounted on an article of cloth- 
ing worn by an operator. 
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